Nov 19 12:46:24 devstack cinder-volume[72763]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72763) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Nov 19 12:46:24 devstack cinder-volume[72763]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72763) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Nov 19 12:46:24 devstack cinder-volume[72763]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72763) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Nov 19 12:46:25 devstack cinder-volume[72763]: INFO dbcounter [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Registered counter for database cinder
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_db.sqlalchemy.engines [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72763) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG dbcounter [-] [72763] Writer thread running {{(pid=72763) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Nov 19 12:46:25 devstack cinder-volume[72763]: INFO cinder.rpc [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 19 12:46:25 devstack cinder-volume[72763]: INFO cinder.rpc [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_db.sqlalchemy.engines [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72763) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 19 12:46:25 devstack cinder-volume[72763]: INFO cinder.volume.manager [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Determined volume DB was empty at startup.
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG cinder.volume.manager [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72763) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Nov 19 12:46:25 devstack cinder-volume[72763]: INFO cinder.volume.manager [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 19 12:46:25 devstack cinder-volume[72763]: WARNING stevedore.named [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 19 12:46:25 devstack cinder-volume[72763]: WARNING castellan.key_manager [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 19 12:46:25 devstack cinder-volume[72763]: WARNING cinder.keymgr.conf_key_mgr [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG cinder.volume.drivers.lvm [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72763) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_concurrency.processutils [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72763) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_concurrency.processutils [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] CMD "cinder-rtstool verify" returned: 0 in 0.299s {{(pid=72763) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_db.sqlalchemy.engines [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72763) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 19 12:46:25 devstack cinder-volume[72763]: INFO cinder.rpc [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Nov 19 12:46:25 devstack cinder-volume[72763]: INFO cinder.rpc [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Nov 19 12:46:25 devstack cinder-volume[72763]: WARNING stevedore.named [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 19 12:46:25 devstack cinder-volume[72763]: WARNING castellan.key_manager [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 19 12:46:25 devstack cinder-volume[72763]: INFO cinder.volume.manager [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_db.sqlalchemy.engines [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72763) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 19 12:46:25 devstack cinder-volume[72763]: INFO oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Starting 1 workers
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Started child 72903 {{(pid=72763) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Full set of CONF: {{(pid=72763) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] ******************************************************************************** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Configuration options gathered from: {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] ================================================================================ {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] allow_availability_zone_fallback = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] allow_compression_on_image_upload = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] allowed_direct_url_schemes     = [] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] api_rate_limit                 = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] auth_strategy                  = keystone {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] az_cache_duration              = 3600 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_availability_zone      = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_host                   = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_name                   = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_stats_polling_interval = 60 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backup_api_class               = cinder.backup.api.API {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backup_name_template           = backup-%s {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backup_use_same_host           = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backup_use_temp_snapshot       = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] chap_password                  = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] chap_username                  =  {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cinder_internal_tenant_project_id = 3039a027ef4147d3900bd3970776a67f {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cinder_internal_tenant_user_id = bf1c8aa47d624cfc96ad3282ba27c94e {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cloned_volume_same_az          = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cluster                        = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] compression_format             = gzip {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] compute_api_class              = cinder.compute.nova.API {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] config_dir                     = [] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] config_source                  = [] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] control_exchange               = openstack {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] debug                          = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] default_availability_zone      = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] default_group_type             = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] default_volume_type            = lvmdriver-1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] driver_client_cert             = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] driver_client_cert_key         = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] driver_data_namespace          = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] driver_ssl_cert_path           = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] driver_ssl_cert_verify         = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] driver_use_ssl                 = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72903]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0)
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] enable_force_upload            = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] enable_new_services            = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] enable_unsupported_driver      = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] enforce_multipath_for_image_xfer = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] filter_function                = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] glance_api_insecure            = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] glance_api_servers             = ['http://192.168.122.161/image'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] glance_api_ssl_compression     = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] glance_ca_certificates_file    = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] glance_catalog_info            = image:glance:publicURL {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] glance_certfile                = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] glance_keyfile                 = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] glance_num_retries             = 3 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] glance_request_timeout         = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] goodness_function              = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] graceful_shutdown_timeout      = 5 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] group_api_class                = cinder.group.api.API {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] host                           = devstack {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] image_compress_on_upload       = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] image_conversion_address_space_limit = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] image_conversion_cpu_limit     = 60 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] image_conversion_disable       = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] image_upload_use_cinder_backend = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] image_upload_use_internal_tenant = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] image_volume_cache_enabled     = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] image_volume_cache_max_count   = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] image_volume_cache_max_size_gb = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] init_host_max_objects_retrieval = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] iscsi_target_flags             =  {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] iscsi_write_cache              = on {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] iser_helper                    = tgtadm {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] iser_ip_address                = 192.168.122.161 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] iser_port                      = 3260 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] log_color                      = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] log_config_append              = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] log_dir                        = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] log_file                       = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] log_options                    = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] log_rotate_interval            = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] log_rotate_interval_type       = days {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] log_rotation_type              = none {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] max_age                        = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] max_logfile_count              = 30 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] max_logfile_size_mb            = 200 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] max_over_subscription_ratio    = 20.0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] message_reap_interval          = 86400 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] message_ttl                    = 2592000 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] migration_create_volume_timeout_secs = 300 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] monkey_patch                   = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] monkey_patch_modules           = [] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] my_ip                          = 192.168.122.161 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] no_snapshot_gb_quota           = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] num_iser_scan_tries            = 3 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] num_shell_tries                = 3 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] num_volume_device_scan_tries   = 3 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] nvmeof_conn_info_version       = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] nvmet_ns_id                    = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] nvmet_port_id                  = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] osapi_max_limit                = 1000 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] osapi_volume_ext_list          = [] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] osapi_volume_listen_port       = 8776 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] osapi_volume_use_ssl           = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] osapi_volume_workers           = 2 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] per_volume_size_limit          = -1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] periodic_fuzzy_delay           = 60 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] periodic_interval              = 60 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] public_endpoint                = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] publish_errors                 = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] quota_backup_gigabytes         = 1000 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] quota_backups                  = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] quota_gigabytes                = 1000 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] quota_groups                   = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] quota_snapshots                = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] quota_volumes                  = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] rate_limit_burst               = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] rate_limit_except_level        = CRITICAL {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] rate_limit_interval            = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] reinit_driver_count            = 3 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] replication_device             = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] report_discard_supported       = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] report_interval                = 120 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] reservation_clean_interval     = 86400 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] reservation_expire             = 86400 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] reserved_image_namespaces      = [] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] reserved_percentage            = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] rpc_response_timeout           = 120 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] run_external_periodic_tasks    = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] scst_target_driver             = iscsi {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] scst_target_iqn_name           = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] service_down_time              = 720 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] shell_completion               = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] snapshot_name_template         = snapshot-%s {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] snapshot_same_host             = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] split_loggers                  = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] state_path                     = /opt/stack/data/cinder {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] storage_availability_zone      = nova {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] storage_protocol               = iSCSI {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] syslog_log_facility            = LOG_USER {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] target_helper                  = lioadm {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:25 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] target_ip_address              = 192.168.122.161 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] target_port                    = 3260 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] target_protocol                = iscsi {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] target_secondary_ip_addresses  = [] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] trace_flags                    = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] transport_url                  = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] until_refresh                  = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] use_chap_auth                  = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] use_default_quota_class        = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] use_journal                    = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] use_json                       = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] use_multipath_for_image_xfer   = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] use_stderr                     = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] use_syslog                     = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] verify_glance_signatures       = enabled {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] volume_api_class               = cinder.volume.api.API {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] volume_backend_name            = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] volume_clear                   = zero {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] volume_clear_ionice            = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] volume_clear_size              = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] volume_copy_bps_limit          = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] volume_dd_blocksize            = 1M {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] volume_name_template           = volume-%s {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] volume_service_inithost_offload = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] volume_usage_audit_period      = month {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] watch_log_file                 = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] zoning_mode                    = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_concurrency.disable_process_locking = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.admin_password = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.admin_token = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.admin_user  = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.auth_port   = 35357 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.auth_protocol = https {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.auth_section = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.auth_type   = password {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.auth_uri    = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.auth_version = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.cache       = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72903]: INFO cinder.volume.manager [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Starting volume driver LVMVolumeDriver (3.0.0)
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.certfile    = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.identity_uri = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.include_service_catalog = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.insecure    = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.interface   = public {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.keyfile     = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.memcache_password =  {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.memcache_username =  {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.region_name = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.service_type = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.backend                  = dogpile.cache.null {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.backend_argument         = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.backend_expiration_time  = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.config_prefix            = cache.oslo {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.dead_timeout             = 60.0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.debug_cache_backend      = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.enable_retry_client      = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.enable_socket_keepalive  = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.enabled                  = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.enforce_fips_mode        = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.expiration_time          = 600 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.hashclient_retry_attempts = 2 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.memcache_dead_retry      = 300 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.memcache_password        = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.memcache_sasl_enabled    = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.memcache_username        = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.proxies                  = [] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.redis_db                 = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.redis_password           = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.redis_server             = localhost:6379 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.redis_socket_timeout     = 1.0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.redis_username           = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.retry_attempts           = 2 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.retry_delay              = 0.0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.socket_keepalive_count   = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.socket_keepalive_idle    = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.socket_keepalive_interval = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.tls_allowed_ciphers      = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.tls_cafile               = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.tls_certfile             = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.tls_enabled              = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cache.tls_keyfile              = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:26 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] coordination.backend_url       = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] database.asyncio_connection    = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] database.asyncio_slave_connection = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] database.backend               = sqlalchemy {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] database.connection            = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] database.connection_debug      = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] database.connection_parameters =  {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] database.connection_recycle_time = 3600 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] database.connection_trace      = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] database.db_inc_retry_interval = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] database.db_max_retries        = 20 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] database.db_max_retry_interval = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] database.db_retry_interval     = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] database.max_overflow          = 50 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] database.max_pool_size         = 5 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] database.max_retries           = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] database.mysql_wsrep_sync_wait = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] database.pool_timeout          = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] database.retry_interval        = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] database.slave_connection      = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] database.sqlite_synchronous    = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] database.use_db_reconnect      = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] profiler.connection_string     = messaging:// {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] profiler.enabled               = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] profiler.es_doc_type           = notification {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] profiler.es_scroll_size        = 10000 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] profiler.es_scroll_time        = 2m {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] profiler.filter_error_trace    = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] profiler.hmac_keys             = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] profiler.sentinel_service_name = mymaster {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] profiler.socket_timeout        = 0.1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] profiler.trace_requests        = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] profiler.trace_sqlalchemy      = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] profiler_jaeger.process_tags   = {} {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] profiler_jaeger.service_name_prefix = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] profiler_otlp.service_name_prefix = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_policy.enforce_new_defaults = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: WARNING oslo_config.cfg [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_policy.enforce_scope      = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_policy.policy_default_rule = default {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] privsep_osbrick.group          = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] privsep_osbrick.helper_command = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] privsep_osbrick.user           = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cinder_sys_admin.group         = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cinder_sys_admin.helper_command = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] cinder_sys_admin.user          = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] service_user.auth_section      = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] service_user.auth_type         = password {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] service_user.certfile          = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] service_user.collect_timing    = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] service_user.insecure          = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] service_user.keyfile           = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] service_user.send_service_user_token = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] service_user.split_loggers     = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] service_user.timeout           = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] glance.auth_section            = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] glance.auth_type               = password {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] glance.certfile                = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] glance.collect_timing          = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] glance.insecure                = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] glance.keyfile                 = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] glance.split_loggers           = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] glance.timeout                 = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.backend_availability_zone = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.chap_password = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.chap_username =  {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.driver_client_cert = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.driver_client_cert_key = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.driver_data_namespace = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.driver_use_ssl = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.extra_capabilities = {} {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.filter_function = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.goodness_function = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.iscsi_target_flags =  {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.iscsi_write_cache = on {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.iser_helper   = tgtadm {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.iser_ip_address = 192.168.122.161 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.iser_port     = 3260 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.lvm_share_target = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.lvm_type      = auto {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.num_shell_tries = 3 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.replication_device = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.report_discard_supported = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.reserved_percentage = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.target_helper = tgtadm {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.target_ip_address = 192.168.122.161 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.target_port   = 3260 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.target_protocol = iscsi {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.trace_flags   = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.unique_fqdn_network = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.use_chap_auth = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.volume_backend_name = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.volume_clear  = zero {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.volume_clear_ionice = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.volume_clear_size = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_reports.file_event_handler = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_reports.log_dir           = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.backend_host       = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.chap_password      = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.chap_username      = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.driver_client_cert = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.extra_capabilities = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.filter_function    = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.goodness_function  = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.iser_helper        = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.iser_ip_address    = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.iser_port          = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.lvm_share_target   = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.lvm_type           = auto {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.num_shell_tries    = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.replication_device = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.report_discard_supported = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.reserved_percentage = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.scst_target_driver = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.storage_protocol   = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.target_helper      = lioadm {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.target_ip_address  = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.target_port        = 3260 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.trace_flags        = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.use_chap_auth      = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.volume_clear       = zero {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.volume_clear_size  = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] lvmdriver-1.volumes_dir        = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_notifications.driver = [] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_notifications.retry = -1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] key_manager.fixed_key          = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] barbican.barbican_api_version  = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] barbican.barbican_endpoint     = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] barbican.barbican_endpoint_type = public {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] barbican.barbican_region_name  = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] barbican.cafile                = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] barbican.certfile              = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] barbican.collect_timing        = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] barbican.insecure              = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] barbican.keyfile               = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] barbican.number_of_retries     = 60 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] barbican.retry_delay           = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] barbican.send_service_user_token = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] barbican.split_loggers         = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] barbican.timeout               = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] barbican.verify_ssl            = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] barbican.verify_ssl_path       = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] barbican_service_user.auth_section = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] barbican_service_user.auth_type = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] barbican_service_user.cafile   = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] barbican_service_user.certfile = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] barbican_service_user.collect_timing = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] barbican_service_user.insecure = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] barbican_service_user.keyfile  = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] barbican_service_user.split_loggers = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] barbican_service_user.timeout  = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] vault.approle_role_id          = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] vault.approle_secret_id        = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] vault.kv_mountpoint            = secret {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] vault.kv_path                  = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] vault.kv_version               = 2 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] vault.namespace                = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] vault.root_token_id            = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] vault.ssl_ca_crt_file          = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] vault.timeout                  = 60.0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] vault.use_ssl                  = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:46:26 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] ******************************************************************************** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Nov 19 12:46:26 devstack sudo[72907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Nov 19 12:46:26 devstack sudo[72907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:46:26 devstack sudo[72907]: pam_unix(sudo:session): session closed for user root
Nov 19 12:46:26 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:26 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:26 devstack sudo[73103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 19 12:46:26 devstack sudo[73103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:46:27 devstack sudo[73103]: pam_unix(sudo:session): session closed for user root
Nov 19 12:46:27 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.587s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:27 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 12:46:27 devstack cinder-volume[72903]: INFO cinder.brick.local_dev.lvm [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Nov 19 12:46:27 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:27 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:27 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:27 devstack sudo[73326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 19 12:46:27 devstack sudo[73326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:46:27 devstack sudo[73326]: pam_unix(sudo:session): session closed for user root
Nov 19 12:46:27 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.542s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:27 devstack cinder-volume[72903]: DEBUG cinder.brick.local_dev.lvm [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72903) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Nov 19 12:46:27 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:27 devstack sudo[73423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 19 12:46:27 devstack sudo[73423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:46:28 devstack sudo[73423]: pam_unix(sudo:session): session closed for user root
Nov 19 12:46:28 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.805s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:28 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:28 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.012s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:28 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:28 devstack sudo[73556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 19 12:46:28 devstack sudo[73556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:46:29 devstack sudo[73556]: pam_unix(sudo:session): session closed for user root
Nov 19 12:46:29 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.479s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:29 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:29 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:29 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:29 devstack sudo[73588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Nov 19 12:46:29 devstack sudo[73588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:46:29 devstack sudo[73588]: pam_unix(sudo:session): session closed for user root
Nov 19 12:46:29 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.505s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:29 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:29 devstack sudo[73594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 19 12:46:29 devstack sudo[73594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:46:30 devstack sudo[73594]: pam_unix(sudo:session): session closed for user root
Nov 19 12:46:30 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.477s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:30 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:30 devstack sudo[73599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 19 12:46:30 devstack sudo[73599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:46:30 devstack sudo[73599]: pam_unix(sudo:session): session closed for user root
Nov 19 12:46:30 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.481s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:30 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:30 devstack sudo[73602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 19 12:46:30 devstack sudo[73602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:46:31 devstack sudo[73602]: pam_unix(sudo:session): session closed for user root
Nov 19 12:46:31 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.479s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:31 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:31 devstack sudo[73607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 19 12:46:31 devstack sudo[73607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:46:31 devstack sudo[73607]: pam_unix(sudo:session): session closed for user root
Nov 19 12:46:31 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.473s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:31 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:31 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.011s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:31 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:31 devstack sudo[73614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 19 12:46:31 devstack sudo[73614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:46:32 devstack sudo[73614]: pam_unix(sudo:session): session closed for user root
Nov 19 12:46:32 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.498s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:32 devstack cinder-volume[72903]: INFO cinder.volume.drivers.lvm [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Enabling LVM thin provisioning by default because a thin pool exists.
Nov 19 12:46:32 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:32 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:32 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:32 devstack sudo[73623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 19 12:46:32 devstack sudo[73623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:46:32 devstack sudo[73623]: pam_unix(sudo:session): session closed for user root
Nov 19 12:46:32 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.482s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:32 devstack cinder-volume[72903]: DEBUG cinder.volume.drivers.lvm [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Updating volume stats {{(pid=72903) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Nov 19 12:46:32 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:32 devstack sudo[73736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 19 12:46:32 devstack sudo[73736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:46:33 devstack sudo[73736]: pam_unix(sudo:session): session closed for user root
Nov 19 12:46:33 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.511s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:33 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:33 devstack sudo[73819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 19 12:46:33 devstack sudo[73819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:46:33 devstack sudo[73819]: pam_unix(sudo:session): session closed for user root
Nov 19 12:46:33 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:33 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:33 devstack sudo[73882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 19 12:46:33 devstack sudo[73882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:46:34 devstack sudo[73882]: pam_unix(sudo:session): session closed for user root
Nov 19 12:46:34 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.460s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:34 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:34 devstack sudo[73886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 19 12:46:34 devstack sudo[73886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:46:34 devstack sudo[73886]: pam_unix(sudo:session): session closed for user root
Nov 19 12:46:34 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:34 devstack cinder-volume[72903]: INFO cinder.volume.driver [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Driver hasn't implemented _init_vendor_properties()
Nov 19 12:46:34 devstack cinder-volume[72903]: DEBUG cinder.volume.driver [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72903) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:849}}
Nov 19 12:46:34 devstack cinder-volume[72903]: DEBUG oslo_db.sqlalchemy.engines [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72903) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 19 12:46:34 devstack cinder-volume[72903]: DEBUG dbcounter [-] [72903] Writer thread running {{(pid=72903) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Nov 19 12:46:34 devstack cinder-volume[72903]: DEBUG cinder.db.sqlalchemy.api [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Building query based on filter {{(pid=72903) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Nov 19 12:46:34 devstack cinder-volume[72903]: DEBUG cinder.image.image_utils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72903) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Nov 19 12:46:34 devstack cinder-volume[72903]: INFO cinder.keymgr.migration [None req-970208bc-03ba-464d-badb-6211edebf899 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 19 12:46:34 devstack cinder-volume[72903]: DEBUG cinder.volume.drivers.lvm [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Updating volume stats {{(pid=72903) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Nov 19 12:46:34 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:34 devstack sudo[73896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 19 12:46:34 devstack sudo[73896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:46:35 devstack sudo[73896]: pam_unix(sudo:session): session closed for user root
Nov 19 12:46:35 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:35 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:35 devstack sudo[73899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 19 12:46:35 devstack sudo[73899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:46:35 devstack sudo[73899]: pam_unix(sudo:session): session closed for user root
Nov 19 12:46:35 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.561s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:35 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:35 devstack sudo[73906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 19 12:46:35 devstack sudo[73906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:46:35 devstack cinder-volume[72763]: DEBUG dbcounter [-] [72763] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72763) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:46:36 devstack sudo[73906]: pam_unix(sudo:session): session closed for user root
Nov 19 12:46:36 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.470s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:36 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:36 devstack sudo[73912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 19 12:46:36 devstack sudo[73912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:46:36 devstack sudo[73912]: pam_unix(sudo:session): session closed for user root
Nov 19 12:46:36 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.513s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:36 devstack cinder-volume[72903]: DEBUG cinder.manager [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Notifying Schedulers of capabilities ... {{(pid=72903) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:46:36 devstack cinder-volume[72903]: INFO cinder.volume.manager [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Driver initialization completed successfully.
Nov 19 12:46:36 devstack cinder-volume[72903]: INFO cinder.manager [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Initiating service 2 cleanup
Nov 19 12:46:36 devstack cinder-volume[72903]: INFO cinder.manager [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Service 2 cleanup completed.
Nov 19 12:46:36 devstack cinder-volume[72903]: DEBUG cinder.service [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Creating RPC server for service cinder-volume {{(pid=72903) start /opt/stack/cinder/cinder/service.py:239}}
Nov 19 12:46:36 devstack cinder-volume[72903]: DEBUG cinder.service [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72903) start /opt/stack/cinder/cinder/service.py:245}}
Nov 19 12:46:36 devstack cinder-volume[72903]: INFO cinder.volume.manager [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Nov 19 12:46:36 devstack cinder-volume[72903]: DEBUG cinder.volume.drivers.lvm [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Updating volume stats {{(pid=72903) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Nov 19 12:46:36 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:36 devstack sudo[73916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 19 12:46:36 devstack sudo[73916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:46:37 devstack sudo[73916]: pam_unix(sudo:session): session closed for user root
Nov 19 12:46:37 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.498s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:37 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:37 devstack sudo[73937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 19 12:46:37 devstack sudo[73937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:46:37 devstack sudo[73937]: pam_unix(sudo:session): session closed for user root
Nov 19 12:46:37 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.498s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:37 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:37 devstack sudo[74078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 19 12:46:37 devstack sudo[74078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:46:38 devstack sudo[74078]: pam_unix(sudo:session): session closed for user root
Nov 19 12:46:38 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.482s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:38 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:46:38 devstack sudo[74098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 19 12:46:38 devstack sudo[74098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:46:38 devstack sudo[74098]: pam_unix(sudo:session): session closed for user root
Nov 19 12:46:38 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.463s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:46:38 devstack cinder-volume[72903]: INFO cinder.volume.manager [None req-802bfb9c-b893-4a78-89c7-e611f5b909da None None] Driver post RPC initialization completed successfully.
Nov 19 12:46:46 devstack cinder-volume[72903]: DEBUG dbcounter [-] [72903] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72903) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:46:48 devstack cinder-volume[72903]: DEBUG dbcounter [-] [72903] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=72903) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:47:32 devstack cinder-volume[72903]: DEBUG oslo_service.periodic_task [None req-f6ea34c4-54d0-434e-a1cd-a551521337e0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 12:47:32 devstack cinder-volume[72903]: DEBUG cinder.volume.drivers.lvm [None req-f6ea34c4-54d0-434e-a1cd-a551521337e0 None None] Updating volume stats {{(pid=72903) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Nov 19 12:47:32 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-f6ea34c4-54d0-434e-a1cd-a551521337e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:47:32 devstack sudo[76295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 19 12:47:32 devstack sudo[76295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:47:33 devstack sudo[76295]: pam_unix(sudo:session): session closed for user root
Nov 19 12:47:33 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-f6ea34c4-54d0-434e-a1cd-a551521337e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.482s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:47:33 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-f6ea34c4-54d0-434e-a1cd-a551521337e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:47:33 devstack sudo[76363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 19 12:47:33 devstack sudo[76363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:47:33 devstack sudo[76363]: pam_unix(sudo:session): session closed for user root
Nov 19 12:47:33 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-f6ea34c4-54d0-434e-a1cd-a551521337e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.468s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:47:33 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-f6ea34c4-54d0-434e-a1cd-a551521337e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:47:33 devstack sudo[76368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 19 12:47:33 devstack sudo[76368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:47:34 devstack sudo[76368]: pam_unix(sudo:session): session closed for user root
Nov 19 12:47:34 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-f6ea34c4-54d0-434e-a1cd-a551521337e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.465s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:47:34 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-f6ea34c4-54d0-434e-a1cd-a551521337e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:47:34 devstack sudo[76371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 19 12:47:34 devstack sudo[76371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:47:34 devstack sudo[76371]: pam_unix(sudo:session): session closed for user root
Nov 19 12:47:34 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-f6ea34c4-54d0-434e-a1cd-a551521337e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.502s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:47:34 devstack cinder-volume[72903]: DEBUG cinder.manager [None req-f6ea34c4-54d0-434e-a1cd-a551521337e0 None None] Notifying Schedulers of capabilities ... {{(pid=72903) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:48:32 devstack cinder-volume[72903]: DEBUG oslo_service.periodic_task [None req-f6ea34c4-54d0-434e-a1cd-a551521337e0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 12:48:32 devstack cinder-volume[72903]: DEBUG cinder.volume.drivers.lvm [None req-f6ea34c4-54d0-434e-a1cd-a551521337e0 None None] Updating volume stats {{(pid=72903) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Nov 19 12:48:32 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-f6ea34c4-54d0-434e-a1cd-a551521337e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:48:32 devstack sudo[79177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 19 12:48:32 devstack sudo[79177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:48:33 devstack sudo[79177]: pam_unix(sudo:session): session closed for user root
Nov 19 12:48:33 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-f6ea34c4-54d0-434e-a1cd-a551521337e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.483s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:48:33 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-f6ea34c4-54d0-434e-a1cd-a551521337e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:48:33 devstack sudo[79180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 19 12:48:33 devstack sudo[79180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:48:33 devstack sudo[79180]: pam_unix(sudo:session): session closed for user root
Nov 19 12:48:33 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-f6ea34c4-54d0-434e-a1cd-a551521337e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.485s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:48:33 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-f6ea34c4-54d0-434e-a1cd-a551521337e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:48:33 devstack sudo[79185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 19 12:48:33 devstack sudo[79185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:48:34 devstack sudo[79185]: pam_unix(sudo:session): session closed for user root
Nov 19 12:48:34 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-f6ea34c4-54d0-434e-a1cd-a551521337e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.468s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:48:34 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-f6ea34c4-54d0-434e-a1cd-a551521337e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:48:34 devstack sudo[79188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 19 12:48:34 devstack sudo[79188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:48:34 devstack sudo[79188]: pam_unix(sudo:session): session closed for user root
Nov 19 12:48:34 devstack cinder-volume[72903]: DEBUG oslo_concurrency.processutils [None req-f6ea34c4-54d0-434e-a1cd-a551521337e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.495s {{(pid=72903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:48:34 devstack cinder-volume[72903]: DEBUG cinder.manager [None req-f6ea34c4-54d0-434e-a1cd-a551521337e0 None None] Notifying Schedulers of capabilities ... {{(pid=72903) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:48:48 devstack cinder-volume[72903]: DEBUG dbcounter [-] [72903] Writing DB stats cinder:SELECT=1 {{(pid=72903) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:48:48 devstack cinder-volume[72903]: DEBUG dbcounter [-] [72903] Writing DB stats cinder:UPDATE=1 {{(pid=72903) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:48:57 devstack cinder-volume[72763]: INFO oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Caught SIGTERM, stopping children
Nov 19 12:48:57 devstack cinder-volume[72763]: DEBUG oslo_concurrency.lockutils [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Acquiring lock "singleton_lock" {{(pid=72763) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Nov 19 12:48:57 devstack cinder-volume[72763]: DEBUG oslo_concurrency.lockutils [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Acquired lock "singleton_lock" {{(pid=72763) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Nov 19 12:48:57 devstack cinder-volume[72763]: DEBUG oslo_concurrency.lockutils [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Releasing lock "singleton_lock" {{(pid=72763) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Nov 19 12:48:57 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Stop services. {{(pid=72763) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Nov 19 12:48:57 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Killing children. {{(pid=72763) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Nov 19 12:48:57 devstack cinder-volume[72763]: INFO oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Waiting on 1 children to exit
Nov 19 12:49:01 devstack cinder-volume[72903]: DEBUG oslo_concurrency.lockutils [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Acquiring lock "singleton_lock" {{(pid=72903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Nov 19 12:49:01 devstack cinder-volume[72903]: DEBUG oslo_concurrency.lockutils [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Acquired lock "singleton_lock" {{(pid=72903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Nov 19 12:49:01 devstack cinder-volume[72903]: DEBUG oslo_concurrency.lockutils [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Releasing lock "singleton_lock" {{(pid=72903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Nov 19 12:49:01 devstack cinder-volume[72903]: WARNING amqp [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 19 12:49:01 devstack cinder-volume[72903]: WARNING amqp [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 19 12:49:01 devstack cinder-volume[72763]: INFO oslo_service.backend._eventlet.service [None req-3cca62a9-fbde-4977-8681-021d95987204 None None] Child 72903 exited with status 0
Nov 19 12:49:03 devstack cinder-volume[80270]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=80270) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Nov 19 12:49:03 devstack cinder-volume[80270]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=80270) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Nov 19 12:49:03 devstack cinder-volume[80270]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=80270) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Nov 19 12:49:04 devstack cinder-volume[80270]: INFO dbcounter [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] Registered counter for database cinder
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_db.sqlalchemy.engines [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80270) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG dbcounter [-] [80270] Writer thread running {{(pid=80270) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Nov 19 12:49:04 devstack cinder-volume[80270]: INFO cinder.rpc [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 19 12:49:04 devstack cinder-volume[80270]: INFO cinder.rpc [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_db.sqlalchemy.engines [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80270) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 19 12:49:04 devstack cinder-volume[80270]: INFO cinder.volume.manager [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] Determined volume DB was empty at startup.
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG cinder.volume.manager [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] Cinder Volume DB check: vol_db_empty=True {{(pid=80270) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Nov 19 12:49:04 devstack cinder-volume[80270]: INFO cinder.volume.manager [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 19 12:49:04 devstack cinder-volume[80270]: WARNING stevedore.named [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 19 12:49:04 devstack cinder-volume[80270]: WARNING castellan.key_manager [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 19 12:49:04 devstack cinder-volume[80270]: WARNING cinder.keymgr.conf_key_mgr [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 19 12:49:04 devstack cinder-volume[80270]: INFO cinder.volume.manager [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_db.sqlalchemy.engines [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80270) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 19 12:49:04 devstack cinder-volume[80270]: INFO oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] Starting 1 workers
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] Started child 80400 {{(pid=80270) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] Full set of CONF: {{(pid=80270) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] ******************************************************************************** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] Configuration options gathered from: {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] ================================================================================ {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] allow_availability_zone_fallback = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] allow_compression_on_image_upload = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] allowed_direct_url_schemes     = [] {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] api_rate_limit                 = True {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] auth_strategy                  = keystone {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_availability_zone      = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_host                   = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_name                   = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_stats_polling_interval = 60 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backup_api_class               = cinder.backup.api.API {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backup_name_template           = backup-%s {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backup_use_same_host           = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backup_use_temp_snapshot       = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] chap_password                  = **** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] chap_username                  =  {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cinder_internal_tenant_project_id = 3039a027ef4147d3900bd3970776a67f {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cinder_internal_tenant_user_id = bf1c8aa47d624cfc96ad3282ba27c94e {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cluster                        = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] compression_format             = gzip {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] compute_api_class              = cinder.compute.nova.API {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] config_dir                     = [] {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] config_source                  = [] {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] control_exchange               = openstack {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] debug                          = True {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] default_availability_zone      = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] default_group_type             = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] default_volume_type            = QuobyteHD {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] driver_client_cert             = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] driver_client_cert_key         = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] driver_data_namespace          = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] driver_ssl_cert_path           = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] driver_ssl_cert_verify         = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] driver_use_ssl                 = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] enable_new_services            = True {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] enable_unsupported_driver      = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] enabled_backends               = ['QuobyteHD'] {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] enforce_multipath_for_image_xfer = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] filter_function                = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] glance_api_insecure            = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80400]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0)
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] glance_api_servers             = ['http://192.168.122.161/image'] {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] glance_api_ssl_compression     = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] glance_ca_certificates_file    = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] glance_catalog_info            = image:glance:publicURL {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] glance_certfile                = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] glance_keyfile                 = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] glance_num_retries             = 3 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] glance_request_timeout         = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] goodness_function              = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] graceful_shutdown_timeout      = 5 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] group_api_class                = cinder.group.api.API {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] host                           = devstack {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] image_compress_on_upload       = True {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] image_conversion_address_space_limit = 1 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] image_conversion_cpu_limit     = 60 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] image_conversion_disable       = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] image_upload_use_cinder_backend = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] image_upload_use_internal_tenant = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] image_volume_cache_enabled     = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] image_volume_cache_max_count   = 0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] image_volume_cache_max_size_gb = 0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] init_host_max_objects_retrieval = 0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] instance_format                = [instance: %(uuid)s]  {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] iscsi_target_flags             =  {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] iscsi_write_cache              = on {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] iser_helper                    = tgtadm {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] iser_ip_address                = 192.168.122.161 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] iser_port                      = 3260 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] log_color                      = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] log_config_append              = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] log_dir                        = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] log_file                       = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] log_options                    = True {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] log_rotate_interval            = 1 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] log_rotate_interval_type       = days {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] log_rotation_type              = none {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] max_age                        = 0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] max_logfile_count              = 30 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] max_logfile_size_mb            = 200 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] max_over_subscription_ratio    = 20.0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] message_reap_interval          = 86400 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] message_ttl                    = 2592000 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] migration_create_volume_timeout_secs = 300 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] monkey_patch                   = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] monkey_patch_modules           = [] {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] my_ip                          = 192.168.122.161 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] no_snapshot_gb_quota           = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] num_iser_scan_tries            = 3 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] num_shell_tries                = 3 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] num_volume_device_scan_tries   = 3 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] nvmeof_conn_info_version       = 1 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] nvmet_ns_id                    = 10 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] nvmet_port_id                  = 1 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] osapi_max_limit                = 1000 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] osapi_volume_ext_list          = [] {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] osapi_volume_listen            = 0.0.0.0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] osapi_volume_listen_port       = 8776 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] osapi_volume_use_ssl           = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80400]: INFO cinder.volume.manager [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Starting volume driver QuobyteDriver (1.1.13)
Nov 19 12:49:04 devstack cinder-volume[80400]: DEBUG cinder.volume.drivers.remotefs [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=80400) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] osapi_volume_workers           = 2 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] per_volume_size_limit          = -1 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] periodic_fuzzy_delay           = 60 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] periodic_interval              = 60 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] project_id_regex               = [0-9a-f\-]+ {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] public_endpoint                = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] publish_errors                 = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] quota_backup_gigabytes         = 1000 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] quota_backups                  = 10 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] quota_gigabytes                = 1000 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] quota_groups                   = 10 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] quota_snapshots                = 10 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] quota_volumes                  = 10 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] rate_limit_burst               = 0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] rate_limit_except_level        = CRITICAL {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] rate_limit_interval            = 0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] reinit_driver_count            = 3 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] replication_device             = **** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] report_discard_supported       = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] report_interval                = 120 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] reservation_clean_interval     = 86400 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] reservation_expire             = 86400 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] reserved_image_namespaces      = [] {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] reserved_percentage            = 0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] rpc_response_timeout           = 120 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] run_external_periodic_tasks    = True {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] scst_target_driver             = iscsi {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] scst_target_iqn_name           = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] service_down_time              = 720 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] shell_completion               = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] snapshot_name_template         = snapshot-%s {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] split_loggers                  = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] state_path                     = /opt/stack/data/cinder {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] storage_availability_zone      = nova {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] storage_protocol               = iSCSI {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] syslog_log_facility            = LOG_USER {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] target_helper                  = lioadm {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] target_ip_address              = 192.168.122.161 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] target_port                    = 3260 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] target_protocol                = iscsi {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] target_secondary_ip_addresses  = [] {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] trace_flags                    = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] transfer_api_class             = cinder.transfer.api.API {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] transport_url                  = **** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] until_refresh                  = 0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] use_chap_auth                  = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] use_default_quota_class        = True {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] use_journal                    = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] use_json                       = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] use_multipath_for_image_xfer   = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] use_stderr                     = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] use_syslog                     = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] verify_glance_signatures       = enabled {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] volume_api_class               = cinder.volume.api.API {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] volume_backend_name            = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] volume_clear                   = zero {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] volume_clear_ionice            = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] volume_clear_size              = 0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] volume_copy_bps_limit          = 0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] volume_dd_blocksize            = 1M {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] volume_name_template           = volume-%s {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] volume_service_inithost_offload = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] volume_usage_audit_period      = month {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] watch_log_file                 = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] zoning_mode                    = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] os_brick.wait_mpath_device_interval = 1 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_concurrency.disable_process_locking = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.admin_password = **** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.admin_tenant_name = admin {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.admin_token = **** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.admin_user  = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.auth_admin_prefix =  {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.auth_port   = 35357 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.auth_protocol = https {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.auth_section = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.auth_type   = password {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.auth_uri    = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.auth_version = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.cache       = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.certfile    = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.delay_auth_decision = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.http_connect_timeout = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.identity_uri = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.include_service_catalog = True {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.insecure    = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.interface   = public {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.keyfile     = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.memcache_password =  {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.memcache_secret_key = **** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.memcache_security_strategy = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.memcache_username =  {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.region_name = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.service_token_roles_required = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.service_type = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.token_cache_time = 300 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] keystone_authtoken.www_authenticate_uri = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.backend                  = dogpile.cache.null {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.backend_argument         = **** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.backend_expiration_time  = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.config_prefix            = cache.oslo {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.dead_timeout             = 60.0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.debug_cache_backend      = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.enable_retry_client      = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.enable_socket_keepalive  = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.enabled                  = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.enforce_fips_mode        = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80400]: DEBUG cinder.volume.drivers.quobyte [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=80400) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 19 12:49:04 devstack cinder-volume[80400]: WARNING cinder.volume.drivers.quobyte [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 19 12:49:04 devstack cinder-volume[80400]: WARNING cinder.volume.drivers.quobyte [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.expiration_time          = 600 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80400]: DEBUG oslo_concurrency.processutils [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Running cmd (subprocess): mount.quobyte {{(pid=80400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.hashclient_retry_attempts = 2 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.hashclient_retry_delay   = 1.0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.memcache_dead_retry      = 300 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.memcache_password        = **** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.memcache_pool_maxsize    = 10 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.memcache_pool_unused_timeout = 60 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.memcache_sasl_enabled    = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.memcache_socket_timeout  = 1.0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.memcache_username        = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.proxies                  = [] {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.redis_db                 = 0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.redis_password           = **** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.redis_sentinel_service_name = mymaster {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.redis_server             = localhost:6379 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.redis_socket_timeout     = 1.0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.redis_username           = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.retry_attempts           = 2 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.retry_delay              = 0.0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.socket_keepalive_count   = 1 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.socket_keepalive_idle    = 1 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.socket_keepalive_interval = 1 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.tls_allowed_ciphers      = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.tls_cafile               = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.tls_certfile             = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.tls_enabled              = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cache.tls_keyfile              = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] coordination.backend_url       = **** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] database.asyncio_connection    = **** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] database.asyncio_slave_connection = **** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] database.backend               = sqlalchemy {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] database.connection            = **** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] database.connection_debug      = 0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] database.connection_parameters =  {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] database.connection_recycle_time = 3600 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] database.connection_trace      = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] database.db_inc_retry_interval = True {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] database.db_max_retries        = 20 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] database.db_max_retry_interval = 10 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] database.db_retry_interval     = 1 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] database.max_overflow          = 50 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] database.max_pool_size         = 5 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] database.max_retries           = 10 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] database.mysql_wsrep_sync_wait = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] database.pool_timeout          = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] database.retry_interval        = 10 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] database.slave_connection      = **** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] database.sqlite_synchronous    = True {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] database.use_db_reconnect      = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] profiler.connection_string     = messaging:// {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] profiler.enabled               = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] profiler.es_doc_type           = notification {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] profiler.es_scroll_size        = 10000 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] profiler.es_scroll_time        = 2m {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] profiler.filter_error_trace    = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] profiler.hmac_keys             = **** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] profiler.sentinel_service_name = mymaster {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] profiler.socket_timeout        = 0.1 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] profiler.trace_requests        = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] profiler.trace_sqlalchemy      = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] profiler_jaeger.process_tags   = {} {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] profiler_jaeger.service_name_prefix = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] profiler_otlp.service_name_prefix = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_policy.enforce_new_defaults = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: WARNING oslo_config.cfg [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_policy.enforce_scope      = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_policy.policy_default_rule = default {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_policy.policy_file        = policy.yaml {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_policy.remote_timeout     = 60.0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] privsep_osbrick.group          = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] privsep_osbrick.helper_command = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] privsep_osbrick.log_daemon_traceback = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] privsep_osbrick.thread_pool_size = 4 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] privsep_osbrick.user           = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cinder_sys_admin.group         = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cinder_sys_admin.helper_command = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] cinder_sys_admin.user          = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] service_user.auth_section      = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] service_user.auth_type         = password {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] service_user.certfile          = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] service_user.collect_timing    = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] service_user.insecure          = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] service_user.keyfile           = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] service_user.send_service_user_token = True {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] service_user.split_loggers     = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] service_user.timeout           = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] glance.auth_section            = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] glance.auth_type               = password {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] glance.certfile                = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] glance.collect_timing          = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] glance.insecure                = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] glance.keyfile                 = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] glance.split_loggers           = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] glance.timeout                 = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.backend_availability_zone = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.chap_password = **** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.chap_username =  {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.driver_client_cert = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.driver_client_cert_key = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.driver_data_namespace = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.driver_ssl_cert_path = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.driver_use_ssl = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.enable_unsupported_driver = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.extra_capabilities = {} {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.filter_function = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.goodness_function = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.image_volume_cache_enabled = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.iscsi_target_flags =  {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.iscsi_write_cache = on {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.iser_helper   = tgtadm {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.iser_ip_address = 192.168.122.161 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.iser_port     = 3260 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.nas_host      =  {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.nas_login     = admin {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.nas_mount_options = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.nas_password  = **** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.nas_private_key =  {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.nas_secure_file_operations = auto {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.nas_share_path =  {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.nas_ssh_port  = 22 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.nas_volume_prov_type = thin {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.num_shell_tries = 3 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.nvmet_port_id = 1 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.quobyte_client_cfg = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.quobyte_volume_url = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.replication_device = **** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.report_discard_supported = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.reserved_percentage = 0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.scst_target_driver = iscsi {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.scst_target_iqn_name = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.storage_protocol = iSCSI {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.target_helper = tgtadm {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.target_ip_address = 192.168.122.161 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.target_port   = 3260 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.target_protocol = iscsi {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.trace_flags   = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.unique_fqdn_network = True {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.use_chap_auth = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.volume_backend_name = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.volume_clear  = zero {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.volume_clear_ionice = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.volume_clear_size = 0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_reports.file_event_handler = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_reports.file_event_handler_interval = 1 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_reports.log_dir           = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.backend_availability_zone = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.backend_host         = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.chap_password        = **** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.chap_username        = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.chiscsi_conf         = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.driver_client_cert   = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.driver_client_cert_key = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.driver_data_namespace = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.driver_use_ssl       = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.enable_unsupported_driver = True {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.extra_capabilities   = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.filter_function      = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.goodness_function    = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.iscsi_target_flags   = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.iscsi_write_cache    = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.iser_helper          = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.iser_ip_address      = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.iser_port            = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.iser_target_prefix   = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.nas_host             = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.nas_login            = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.nas_mount_options    = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.nas_password         = **** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.nas_private_key      = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.nas_secure_file_operations = false {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.nas_share_path       = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.nas_ssh_port         = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.nas_volume_prov_type = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.num_shell_tries      = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.nvmet_ns_id          = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.nvmet_port_id        = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.replication_device   = **** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.report_discard_supported = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.reserved_percentage  = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.scst_target_driver   = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.scst_target_iqn_name = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.storage_protocol     = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.target_helper        = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.target_ip_address    = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.target_port          = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.target_prefix        = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.target_protocol      = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.trace_flags          = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.unique_fqdn_network  = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.use_chap_auth        = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.volume_clear         = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.volume_clear_ionice  = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.volume_clear_size    = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] QuobyteHD.volumes_dir          = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.hostname = devstack {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack quobyte-client[80402]: Reading configuration file: /etc/quobyte/client.cfg
Nov 19 12:49:04 devstack quobyte-client[80402]: Invalid parameters found, error: missing mount point.
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack quobyte-client[80402]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 19 12:49:04 devstack quobyte-client[80402]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.ssl      = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80400]: DEBUG oslo_concurrency.processutils [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] CMD "mount.quobyte" returned: 1 in 0.248s {{(pid=80400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:49:04 devstack cinder-volume[80400]: DEBUG oslo_concurrency.lockutils [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80400) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:49:04 devstack cinder-volume[80400]: DEBUG oslo_concurrency.lockutils [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80400) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:49:04 devstack cinder-volume[80400]: DEBUG cinder.volume.drivers.quobyte [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80400) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:49:04 devstack cinder-volume[80400]: INFO cinder.volume.drivers.quobyte [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 ...
Nov 19 12:49:04 devstack cinder-volume[80400]: DEBUG oslo_concurrency.processutils [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 -c /etc/quobyte/client-cinder.cfg {{(pid=80400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.ssl_version =  {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_notifications.driver = [] {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_notifications.retry = -1 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] oslo_messaging_notifications.transport_url = **** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] key_manager.fixed_key          = **** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] barbican.barbican_api_version  = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] barbican.barbican_endpoint     = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] barbican.barbican_endpoint_type = public {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] barbican.barbican_region_name  = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] barbican.cafile                = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] barbican.certfile              = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] barbican.collect_timing        = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] barbican.insecure              = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] barbican.keyfile               = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] barbican.number_of_retries     = 60 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] barbican.retry_delay           = 1 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] barbican.send_service_user_token = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] barbican.split_loggers         = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] barbican.timeout               = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] barbican.verify_ssl            = True {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] barbican.verify_ssl_path       = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] barbican_service_user.auth_section = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] barbican_service_user.auth_type = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] barbican_service_user.cafile   = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] barbican_service_user.certfile = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] barbican_service_user.collect_timing = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] barbican_service_user.insecure = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] barbican_service_user.keyfile  = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] barbican_service_user.split_loggers = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] barbican_service_user.timeout  = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] vault.approle_role_id          = **** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] vault.approle_secret_id        = **** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] vault.kv_mountpoint            = secret {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] vault.kv_path                  = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] vault.kv_version               = 2 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] vault.namespace                = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] vault.root_token_id            = **** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] vault.ssl_ca_crt_file          = None {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] vault.timeout                  = 60.0 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] vault.use_ssl                  = False {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:04 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] ******************************************************************************** {{(pid=80270) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Nov 19 12:49:04 devstack sudo[80432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 -c /etc/quobyte/client-cinder.cfg
Nov 19 12:49:04 devstack sudo[80432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:49:05 devstack sudo[80432]: pam_unix(sudo:session): session closed for user root
Nov 19 12:49:05 devstack cinder-volume[80400]: DEBUG oslo_concurrency.processutils [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.635s {{(pid=80400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:49:05 devstack cinder-volume[80400]: INFO cinder.volume.drivers.quobyte [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 succeeded
Nov 19 12:49:05 devstack cinder-volume[80400]: DEBUG cinder.volume.drivers.quobyte [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80400) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:49:05 devstack cinder-volume[80400]: DEBUG oslo_concurrency.lockutils [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.646s {{(pid=80400) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:49:05 devstack cinder-volume[80400]: DEBUG oslo_concurrency.processutils [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:49:05 devstack sudo[80504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:49:05 devstack sudo[80504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:49:06 devstack sudo[80504]: pam_unix(sudo:session): session closed for user root
Nov 19 12:49:06 devstack cinder-volume[80400]: DEBUG oslo_concurrency.processutils [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.439s {{(pid=80400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:49:06 devstack cinder-volume[80400]: INFO cinder.volume.driver [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Driver hasn't implemented _init_vendor_properties()
Nov 19 12:49:06 devstack cinder-volume[80400]: DEBUG cinder.volume.driver [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 230.98544311523438, 'free_capacity_gb': 230.98544311523438, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=80400) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:849}}
Nov 19 12:49:06 devstack cinder-volume[80400]: DEBUG oslo_db.sqlalchemy.engines [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80400) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 19 12:49:06 devstack cinder-volume[80400]: DEBUG dbcounter [-] [80400] Writer thread running {{(pid=80400) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Nov 19 12:49:06 devstack cinder-volume[80400]: DEBUG cinder.db.sqlalchemy.api [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Building query based on filter {{(pid=80400) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Nov 19 12:49:06 devstack cinder-volume[80400]: DEBUG cinder.image.image_utils [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=80400) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Nov 19 12:49:06 devstack cinder-volume[80400]: INFO cinder.keymgr.migration [None req-a6b645db-13ca-4817-9d3d-2498ff300ed3 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 19 12:49:06 devstack cinder-volume[80400]: DEBUG oslo_concurrency.lockutils [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80400) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:49:06 devstack cinder-volume[80400]: DEBUG oslo_concurrency.lockutils [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80400) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:49:06 devstack cinder-volume[80400]: DEBUG cinder.volume.drivers.quobyte [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80400) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:49:06 devstack cinder-volume[80400]: DEBUG cinder.volume.drivers.quobyte [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80400) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:49:06 devstack cinder-volume[80400]: DEBUG oslo_concurrency.lockutils [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=80400) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:49:06 devstack cinder-volume[80400]: DEBUG oslo_concurrency.processutils [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:49:06 devstack sudo[80529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:49:06 devstack sudo[80529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:49:06 devstack sudo[80529]: pam_unix(sudo:session): session closed for user root
Nov 19 12:49:06 devstack cinder-volume[80400]: DEBUG oslo_concurrency.processutils [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.455s {{(pid=80400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:49:06 devstack cinder-volume[80400]: DEBUG cinder.manager [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Notifying Schedulers of capabilities ... {{(pid=80400) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:49:06 devstack cinder-volume[80400]: INFO cinder.volume.manager [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Driver initialization completed successfully.
Nov 19 12:49:06 devstack cinder-volume[80400]: INFO cinder.manager [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Initiating service 3 cleanup
Nov 19 12:49:06 devstack cinder-volume[80400]: INFO cinder.manager [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Service 3 cleanup completed.
Nov 19 12:49:06 devstack cinder-volume[80400]: DEBUG cinder.service [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Creating RPC server for service cinder-volume {{(pid=80400) start /opt/stack/cinder/cinder/service.py:239}}
Nov 19 12:49:06 devstack cinder-volume[80400]: DEBUG cinder.service [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=80400) start /opt/stack/cinder/cinder/service.py:245}}
Nov 19 12:49:06 devstack cinder-volume[80400]: INFO cinder.volume.manager [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13)
Nov 19 12:49:06 devstack cinder-volume[80400]: DEBUG oslo_concurrency.lockutils [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80400) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:49:06 devstack cinder-volume[80400]: DEBUG oslo_concurrency.lockutils [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80400) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:49:06 devstack cinder-volume[80400]: DEBUG cinder.volume.drivers.quobyte [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80400) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:49:06 devstack cinder-volume[80400]: DEBUG cinder.volume.drivers.quobyte [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80400) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:49:06 devstack cinder-volume[80400]: DEBUG oslo_concurrency.lockutils [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80400) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:49:06 devstack cinder-volume[80400]: DEBUG oslo_concurrency.processutils [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:49:06 devstack sudo[80545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:49:06 devstack sudo[80545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:49:07 devstack sudo[80545]: pam_unix(sudo:session): session closed for user root
Nov 19 12:49:07 devstack cinder-volume[80400]: DEBUG oslo_concurrency.processutils [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.469s {{(pid=80400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:49:07 devstack cinder-volume[80400]: INFO cinder.volume.manager [None req-cac7bb13-5cb2-414f-a060-eedc606ed477 None None] Driver post RPC initialization completed successfully.
Nov 19 12:49:10 devstack cinder-volume[80400]: DEBUG oslo_concurrency.lockutils [None req-03054837-b0ea-4391-84ad-6f1294872107 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80400) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:49:10 devstack cinder-volume[80400]: DEBUG oslo_concurrency.lockutils [None req-03054837-b0ea-4391-84ad-6f1294872107 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80400) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:49:10 devstack cinder-volume[80400]: DEBUG cinder.volume.drivers.quobyte [None req-03054837-b0ea-4391-84ad-6f1294872107 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80400) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:49:10 devstack cinder-volume[80400]: DEBUG cinder.volume.drivers.quobyte [None req-03054837-b0ea-4391-84ad-6f1294872107 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80400) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:49:10 devstack cinder-volume[80400]: DEBUG oslo_concurrency.lockutils [None req-03054837-b0ea-4391-84ad-6f1294872107 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80400) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:49:10 devstack cinder-volume[80400]: DEBUG oslo_concurrency.processutils [None req-03054837-b0ea-4391-84ad-6f1294872107 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:49:10 devstack sudo[80643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:49:10 devstack sudo[80643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:49:10 devstack sudo[80643]: pam_unix(sudo:session): session closed for user root
Nov 19 12:49:10 devstack cinder-volume[80400]: DEBUG oslo_concurrency.processutils [None req-03054837-b0ea-4391-84ad-6f1294872107 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.422s {{(pid=80400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:49:10 devstack cinder-volume[80400]: DEBUG cinder.manager [None req-03054837-b0ea-4391-84ad-6f1294872107 None None] Notifying Schedulers of capabilities ... {{(pid=80400) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:49:13 devstack cinder-volume[80270]: INFO oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] Caught SIGTERM, stopping children
Nov 19 12:49:13 devstack cinder-volume[80270]: DEBUG oslo_concurrency.lockutils [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] Acquiring lock "singleton_lock" {{(pid=80270) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Nov 19 12:49:13 devstack cinder-volume[80270]: DEBUG oslo_concurrency.lockutils [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] Acquired lock "singleton_lock" {{(pid=80270) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Nov 19 12:49:13 devstack cinder-volume[80270]: DEBUG oslo_concurrency.lockutils [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] Releasing lock "singleton_lock" {{(pid=80270) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Nov 19 12:49:13 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] Stop services. {{(pid=80270) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Nov 19 12:49:13 devstack cinder-volume[80270]: DEBUG oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] Killing children. {{(pid=80270) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Nov 19 12:49:13 devstack cinder-volume[80270]: INFO oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] Waiting on 1 children to exit
Nov 19 12:49:14 devstack cinder-volume[80400]: DEBUG oslo_concurrency.lockutils [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] Acquiring lock "singleton_lock" {{(pid=80400) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Nov 19 12:49:14 devstack cinder-volume[80400]: DEBUG oslo_concurrency.lockutils [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] Acquired lock "singleton_lock" {{(pid=80400) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Nov 19 12:49:14 devstack cinder-volume[80400]: DEBUG oslo_concurrency.lockutils [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] Releasing lock "singleton_lock" {{(pid=80400) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Nov 19 12:49:14 devstack cinder-volume[80400]: WARNING amqp [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 19 12:49:14 devstack cinder-volume[80400]: WARNING amqp [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 19 12:49:14 devstack cinder-volume[80270]: INFO oslo_service.backend._eventlet.service [None req-2c154713-3238-41c0-8c69-c4cd322f03bf None None] Child 80400 exited with status 0
Nov 19 12:49:16 devstack cinder-volume[80705]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=80705) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Nov 19 12:49:16 devstack cinder-volume[80705]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=80705) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Nov 19 12:49:16 devstack cinder-volume[80705]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=80705) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Nov 19 12:49:17 devstack cinder-volume[80705]: INFO dbcounter [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] Registered counter for database cinder
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_db.sqlalchemy.engines [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80705) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG dbcounter [-] [80705] Writer thread running {{(pid=80705) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Nov 19 12:49:17 devstack cinder-volume[80705]: INFO cinder.rpc [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 19 12:49:17 devstack cinder-volume[80705]: INFO cinder.rpc [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_db.sqlalchemy.engines [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80705) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 19 12:49:17 devstack cinder-volume[80705]: INFO cinder.volume.manager [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] Determined volume DB was empty at startup.
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG cinder.volume.manager [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=80705) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Nov 19 12:49:17 devstack cinder-volume[80705]: WARNING stevedore.named [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 19 12:49:17 devstack cinder-volume[80705]: WARNING castellan.key_manager [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 19 12:49:17 devstack cinder-volume[80705]: WARNING cinder.keymgr.conf_key_mgr [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 19 12:49:17 devstack cinder-volume[80705]: INFO cinder.volume.manager [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_db.sqlalchemy.engines [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80705) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 19 12:49:17 devstack cinder-volume[80705]: INFO oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] Starting 1 workers
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] Started child 80839 {{(pid=80705) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] Full set of CONF: {{(pid=80705) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] ******************************************************************************** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] Configuration options gathered from: {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] ================================================================================ {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] allow_availability_zone_fallback = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] allow_compression_on_image_upload = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] allowed_direct_url_schemes     = [] {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] api_rate_limit                 = True {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] auth_strategy                  = keystone {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_availability_zone      = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_host                   = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_name                   = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_stats_polling_interval = 60 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backup_api_class               = cinder.backup.api.API {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backup_name_template           = backup-%s {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backup_use_same_host           = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backup_use_temp_snapshot       = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] chap_password                  = **** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] chap_username                  =  {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cinder_internal_tenant_project_id = 3039a027ef4147d3900bd3970776a67f {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cinder_internal_tenant_user_id = bf1c8aa47d624cfc96ad3282ba27c94e {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80839]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0)
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cluster                        = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] compression_format             = gzip {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] compute_api_class              = cinder.compute.nova.API {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] config_dir                     = [] {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] config_source                  = [] {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] control_exchange               = openstack {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] debug                          = True {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] default_availability_zone      = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] default_group_type             = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] default_volume_type            = QuobyteHD {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] driver_client_cert             = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] driver_client_cert_key         = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] driver_data_namespace          = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] driver_ssl_cert_path           = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] driver_ssl_cert_verify         = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] driver_use_ssl                 = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] enable_new_services            = True {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] enable_unsupported_driver      = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] enabled_backends               = ['QuobyteHD'] {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] enforce_multipath_for_image_xfer = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] filter_function                = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] glance_api_insecure            = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] glance_api_servers             = ['http://192.168.122.161/image'] {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] glance_api_ssl_compression     = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] glance_ca_certificates_file    = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] glance_catalog_info            = image:glance:publicURL {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] glance_certfile                = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] glance_keyfile                 = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] glance_num_retries             = 3 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] glance_request_timeout         = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] goodness_function              = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] graceful_shutdown_timeout      = 5 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] group_api_class                = cinder.group.api.API {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] host                           = devstack {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] image_compress_on_upload       = True {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] image_conversion_address_space_limit = 1 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] image_conversion_cpu_limit     = 60 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] image_conversion_disable       = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] image_upload_use_cinder_backend = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] image_upload_use_internal_tenant = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] image_volume_cache_enabled     = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] image_volume_cache_max_count   = 0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] image_volume_cache_max_size_gb = 0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] init_host_max_objects_retrieval = 0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] instance_format                = [instance: %(uuid)s]  {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] iscsi_target_flags             =  {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] iscsi_write_cache              = on {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] iser_helper                    = tgtadm {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] iser_ip_address                = 192.168.122.161 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] iser_port                      = 3260 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] log_color                      = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] log_config_append              = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] log_dir                        = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] log_file                       = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] log_options                    = True {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] log_rotate_interval            = 1 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] log_rotate_interval_type       = days {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] log_rotation_type              = none {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] max_age                        = 0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] max_logfile_count              = 30 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] max_logfile_size_mb            = 200 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] max_over_subscription_ratio    = 20.0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] message_reap_interval          = 86400 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] message_ttl                    = 2592000 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] migration_create_volume_timeout_secs = 300 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] monkey_patch                   = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] monkey_patch_modules           = [] {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Starting volume driver QuobyteDriver (1.1.13)
Nov 19 12:49:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=80839) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] my_ip                          = 192.168.122.161 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] no_snapshot_gb_quota           = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] num_iser_scan_tries            = 3 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] num_shell_tries                = 3 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] num_volume_device_scan_tries   = 3 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] nvmeof_conn_info_version       = 1 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] nvmet_ns_id                    = 10 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] nvmet_port_id                  = 1 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] osapi_max_limit                = 1000 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] osapi_volume_ext_list          = [] {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] osapi_volume_listen            = 0.0.0.0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] osapi_volume_listen_port       = 8776 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] osapi_volume_use_ssl           = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] osapi_volume_workers           = 2 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] per_volume_size_limit          = -1 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] periodic_fuzzy_delay           = 60 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] periodic_interval              = 60 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] project_id_regex               = [0-9a-f\-]+ {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] public_endpoint                = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] publish_errors                 = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] quota_backup_gigabytes         = 1000 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] quota_backups                  = 10 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] quota_gigabytes                = 1000 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] quota_groups                   = 10 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] quota_snapshots                = 10 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] quota_volumes                  = 10 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] rate_limit_burst               = 0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] rate_limit_except_level        = CRITICAL {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] rate_limit_interval            = 0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] reinit_driver_count            = 3 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] replication_device             = **** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] report_discard_supported       = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] report_interval                = 120 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] reservation_clean_interval     = 86400 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] reservation_expire             = 86400 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] reserved_image_namespaces      = [] {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] reserved_percentage            = 0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] rpc_response_timeout           = 120 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] run_external_periodic_tasks    = True {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] scst_target_driver             = iscsi {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] scst_target_iqn_name           = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] service_down_time              = 720 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] shell_completion               = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] snapshot_name_template         = snapshot-%s {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] split_loggers                  = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] state_path                     = /opt/stack/data/cinder {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] storage_availability_zone      = nova {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] storage_protocol               = iSCSI {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] syslog_log_facility            = LOG_USER {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] target_helper                  = lioadm {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] target_ip_address              = 192.168.122.161 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] target_port                    = 3260 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] target_protocol                = iscsi {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] target_secondary_ip_addresses  = [] {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] trace_flags                    = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] transfer_api_class             = cinder.transfer.api.API {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] transport_url                  = **** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] until_refresh                  = 0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] use_chap_auth                  = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] use_default_quota_class        = True {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] use_journal                    = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] use_json                       = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] use_multipath_for_image_xfer   = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] use_stderr                     = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] use_syslog                     = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] verify_glance_signatures       = enabled {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] volume_api_class               = cinder.volume.api.API {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] volume_backend_name            = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] volume_clear                   = zero {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] volume_clear_ionice            = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] volume_clear_size              = 0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] volume_copy_bps_limit          = 0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] volume_dd_blocksize            = 1M {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] volume_name_template           = volume-%s {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] volume_service_inithost_offload = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] volume_usage_audit_period      = month {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] watch_log_file                 = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] zoning_mode                    = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_concurrency.disable_process_locking = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.admin_password = **** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.admin_tenant_name = admin {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.admin_token = **** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.admin_user  = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.auth_admin_prefix =  {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.auth_port   = 35357 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.auth_protocol = https {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.auth_section = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.auth_type   = password {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.auth_uri    = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.auth_version = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.cache       = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.certfile    = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.delay_auth_decision = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.http_connect_timeout = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.identity_uri = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.include_service_catalog = True {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.insecure    = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.interface   = public {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.keyfile     = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.memcache_password =  {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.memcache_username =  {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.region_name = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.service_token_roles_required = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.service_type = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.token_cache_time = 300 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] keystone_authtoken.www_authenticate_uri = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.backend                  = dogpile.cache.null {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:17 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.backend_argument         = **** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=80839) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 19 12:49:18 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.quobyte [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 19 12:49:18 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.quobyte [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 19 12:49:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Running cmd (subprocess): mount.quobyte {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.backend_expiration_time  = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.config_prefix            = cache.oslo {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.dead_timeout             = 60.0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.debug_cache_backend      = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.enable_retry_client      = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.enable_socket_keepalive  = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.enabled                  = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.enforce_fips_mode        = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.expiration_time          = 600 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.hashclient_retry_attempts = 2 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.hashclient_retry_delay   = 1.0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.memcache_dead_retry      = 300 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.memcache_password        = **** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.memcache_pool_maxsize    = 10 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.memcache_sasl_enabled    = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.memcache_socket_timeout  = 1.0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.memcache_username        = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.proxies                  = [] {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.redis_db                 = 0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.redis_password           = **** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.redis_sentinel_service_name = mymaster {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.redis_server             = localhost:6379 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.redis_socket_timeout     = 1.0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.redis_username           = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.retry_attempts           = 2 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.retry_delay              = 0.0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.socket_keepalive_count   = 1 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.socket_keepalive_idle    = 1 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.socket_keepalive_interval = 1 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.tls_allowed_ciphers      = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.tls_cafile               = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.tls_certfile             = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.tls_enabled              = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cache.tls_keyfile              = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] coordination.backend_url       = **** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] database.asyncio_connection    = **** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] database.asyncio_slave_connection = **** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] database.backend               = sqlalchemy {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] database.connection            = **** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] database.connection_debug      = 0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] database.connection_parameters =  {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] database.connection_recycle_time = 3600 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] database.connection_trace      = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] database.db_inc_retry_interval = True {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] database.db_max_retries        = 20 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] database.db_max_retry_interval = 10 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] database.db_retry_interval     = 1 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] database.max_overflow          = 50 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] database.max_pool_size         = 5 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] database.max_retries           = 10 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] database.mysql_wsrep_sync_wait = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] database.pool_timeout          = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] database.retry_interval        = 10 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] database.slave_connection      = **** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] database.sqlite_synchronous    = True {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] database.use_db_reconnect      = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] profiler.connection_string     = messaging:// {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] profiler.enabled               = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] profiler.es_doc_type           = notification {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] profiler.es_scroll_size        = 10000 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] profiler.es_scroll_time        = 2m {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] profiler.filter_error_trace    = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] profiler.hmac_keys             = **** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] profiler.sentinel_service_name = mymaster {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] profiler.socket_timeout        = 0.1 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] profiler.trace_requests        = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] profiler.trace_sqlalchemy      = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] profiler_jaeger.process_tags   = {} {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] profiler_jaeger.service_name_prefix = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] profiler_otlp.service_name_prefix = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_policy.enforce_new_defaults = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: WARNING oslo_config.cfg [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_policy.enforce_scope      = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_policy.policy_default_rule = default {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_policy.policy_file        = policy.yaml {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_policy.remote_timeout     = 60.0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] privsep_osbrick.group          = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] privsep_osbrick.helper_command = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] privsep_osbrick.user           = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cinder_sys_admin.group         = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cinder_sys_admin.helper_command = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] cinder_sys_admin.user          = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] service_user.auth_section      = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] service_user.auth_type         = password {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] service_user.certfile          = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] service_user.collect_timing    = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] service_user.insecure          = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] service_user.keyfile           = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] service_user.send_service_user_token = True {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] service_user.split_loggers     = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] service_user.timeout           = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] glance.auth_section            = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] glance.auth_type               = password {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] glance.certfile                = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] glance.collect_timing          = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] glance.insecure                = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] glance.keyfile                 = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] glance.split_loggers           = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] glance.timeout                 = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.backend_availability_zone = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.chap_password = **** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.chap_username =  {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.driver_client_cert = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.driver_client_cert_key = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack quobyte-client[80869]: Reading configuration file: /etc/quobyte/client.cfg
Nov 19 12:49:18 devstack quobyte-client[80869]: Invalid parameters found, error: missing mount point.
Nov 19 12:49:18 devstack quobyte-client[80869]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 19 12:49:18 devstack quobyte-client[80869]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.driver_data_namespace = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.driver_use_ssl = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.enable_unsupported_driver = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.extra_capabilities = {} {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.filter_function = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.goodness_function = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.iscsi_target_flags =  {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.iscsi_write_cache = on {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.iser_helper   = tgtadm {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.iser_ip_address = 192.168.122.161 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.iser_port     = 3260 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.nas_host      =  {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.nas_login     = admin {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.nas_mount_options = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.nas_password  = **** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.nas_private_key =  {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.nas_share_path =  {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.nas_ssh_port  = 22 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.num_shell_tries = 3 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.nvmet_port_id = 1 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.quobyte_client_cfg = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] CMD "mount.quobyte" returned: 1 in 0.113s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:49:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:49:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:49:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:49:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:49:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.quobyte_volume_url = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.replication_device = **** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.report_discard_supported = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.reserved_percentage = 0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.scst_target_driver = iscsi {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.scst_target_iqn_name = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.storage_protocol = iSCSI {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.target_helper = tgtadm {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.target_ip_address = 192.168.122.161 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.target_port   = 3260 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.target_protocol = iscsi {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.trace_flags   = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.unique_fqdn_network = True {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.use_chap_auth = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.volume_backend_name = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.volume_clear  = zero {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.volume_clear_ionice = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.volume_clear_size = 0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_reports.file_event_handler = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_reports.log_dir           = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.backend_availability_zone = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.backend_host         = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.chap_password        = **** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.chap_username        = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.chiscsi_conf         = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.driver_client_cert   = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.driver_client_cert_key = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.driver_data_namespace = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.driver_use_ssl       = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.extra_capabilities   = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.filter_function      = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.goodness_function    = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.iscsi_target_flags   = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.iscsi_write_cache    = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.iser_helper          = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.iser_ip_address      = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.iser_port            = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.iser_target_prefix   = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.nas_host             = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.nas_login            = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.nas_mount_options    = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.nas_password         = **** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.nas_private_key      = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.nas_share_path       = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.nas_ssh_port         = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.num_shell_tries      = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.nvmet_ns_id          = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.nvmet_port_id        = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.replication_device   = **** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.report_discard_supported = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.reserved_percentage  = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.scst_target_driver   = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack sudo[80877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack sudo[80877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.storage_protocol     = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.target_helper        = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.target_ip_address    = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.target_port          = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.target_prefix        = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.target_protocol      = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.trace_flags          = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.unique_fqdn_network  = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.use_chap_auth        = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.volume_clear         = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.volume_clear_ionice  = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.volume_clear_size    = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] QuobyteHD.volumes_dir          = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.ssl      = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_notifications.driver = [] {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_notifications.retry = -1 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] oslo_messaging_notifications.transport_url = **** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] key_manager.fixed_key          = **** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] barbican.barbican_api_version  = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] barbican.barbican_endpoint     = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] barbican.barbican_endpoint_type = public {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] barbican.barbican_region_name  = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] barbican.cafile                = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] barbican.certfile              = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] barbican.collect_timing        = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] barbican.insecure              = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] barbican.keyfile               = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] barbican.number_of_retries     = 60 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] barbican.retry_delay           = 1 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] barbican.send_service_user_token = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] barbican.split_loggers         = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] barbican.timeout               = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] barbican.verify_ssl            = True {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] barbican.verify_ssl_path       = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] barbican_service_user.auth_section = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] barbican_service_user.auth_type = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] barbican_service_user.cafile   = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] barbican_service_user.certfile = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] barbican_service_user.collect_timing = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] barbican_service_user.insecure = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] barbican_service_user.keyfile  = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] barbican_service_user.split_loggers = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] barbican_service_user.timeout  = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] vault.approle_role_id          = **** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] vault.approle_secret_id        = **** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] vault.kv_mountpoint            = secret {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] vault.kv_path                  = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] vault.kv_version               = 2 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] vault.namespace                = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] vault.root_token_id            = **** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] vault.ssl_ca_crt_file          = None {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] vault.timeout                  = 60.0 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] vault.use_ssl                  = False {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Nov 19 12:49:18 devstack cinder-volume[80705]: DEBUG oslo_service.backend._eventlet.service [None req-89929b99-26ed-4ec1-8e5e-6313db988e3f None None] ******************************************************************************** {{(pid=80705) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Nov 19 12:49:18 devstack sudo[80877]: pam_unix(sudo:session): session closed for user root
Nov 19 12:49:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.871s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:49:18 devstack cinder-volume[80839]: INFO cinder.volume.driver [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Driver hasn't implemented _init_vendor_properties()
Nov 19 12:49:18 devstack cinder-volume[80839]: DEBUG cinder.volume.driver [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 230.98544311523438, 'free_capacity_gb': 230.98544311523438, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=80839) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:849}}
Nov 19 12:49:19 devstack cinder-volume[80839]: DEBUG oslo_db.sqlalchemy.engines [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80839) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 19 12:49:19 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writer thread running {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Nov 19 12:49:19 devstack cinder-volume[80839]: DEBUG cinder.db.sqlalchemy.api [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Building query based on filter {{(pid=80839) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Nov 19 12:49:19 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=80839) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Nov 19 12:49:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:49:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:49:19 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:49:19 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:49:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:49:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:49:19 devstack cinder-volume[80839]: INFO cinder.keymgr.migration [None req-9d79bfd3-f947-40b5-b97f-a67d37e2d33b None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 19 12:49:19 devstack sudo[80933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:49:19 devstack sudo[80933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:49:19 devstack sudo[80933]: pam_unix(sudo:session): session closed for user root
Nov 19 12:49:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.751s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:49:19 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:49:19 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Driver initialization completed successfully.
Nov 19 12:49:19 devstack cinder-volume[80839]: INFO cinder.manager [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Initiating service 3 cleanup
Nov 19 12:49:19 devstack cinder-volume[80839]: INFO cinder.manager [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Service 3 cleanup completed.
Nov 19 12:49:19 devstack cinder-volume[80839]: DEBUG cinder.service [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Creating RPC server for service cinder-volume {{(pid=80839) start /opt/stack/cinder/cinder/service.py:239}}
Nov 19 12:49:19 devstack cinder-volume[80839]: DEBUG cinder.service [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=80839) start /opt/stack/cinder/cinder/service.py:245}}
Nov 19 12:49:19 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13)
Nov 19 12:49:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:49:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:49:19 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:49:19 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:49:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:49:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:49:19 devstack sudo[80961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:49:19 devstack sudo[80961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:49:20 devstack sudo[80961]: pam_unix(sudo:session): session closed for user root
Nov 19 12:49:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.460s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:49:20 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-24a6a083-f807-4f34-9e77-63af1ecee25c None None] Driver post RPC initialization completed successfully.
Nov 19 12:49:27 devstack cinder-volume[80705]: DEBUG dbcounter [-] [80705] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=80705) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:49:29 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:49:30 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=2 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Flow 'volume_create_manager' (c8871fa6-b580-4361-8f3e-7eaa8fdbca1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e5e2183-1943-405f-b279-e01a82d5398f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e5e2183-1943-405f-b279-e01a82d5398f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1673872097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ca56654-2444-449a-a91d-450cb1b4f257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7154328a7b414c4db1b284597fccb90c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:50:20Z,use_quota=True,user_id='b388b8d4fdd243ebbc4ca4b8ea5c9e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (054aad6e-3512-4fc8-b849-fd48b8fb935e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (054aad6e-3512-4fc8-b849-fd48b8fb935e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bcc861f-93d5-4f24-85cd-37111e4e1160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.image.glance [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Creating Keystone auth plugin from conf {{(pid=80839) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Flow 'volume_create_manager' (3aa3ff8d-003d-4fd5-a516-1d463b9608ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (156872dd-6a20-4739-a9b6-811cb77158f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (156872dd-6a20-4739-a9b6-811cb77158f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-197294408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8459477c-42c2-4f0c-b93d-b01fe0e2a896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8becb7fd97d41e187f8ec686d80d4de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:50:20Z,use_quota=True,user_id='9faf6082328c4469a5c45f254003022d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab5c3aa0-f9dd-4334-9c5f-3453700a82fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab5c3aa0-f9dd-4334-9c5f-3453700a82fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eabb200e-a18d-471c-ae70-aae84cc526f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eabb200e-a18d-471c-ae70-aae84cc526f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8459477c-42c2-4f0c-b93d-b01fe0e2a896', 'volume_name': 'volume-8459477c-42c2-4f0c-b93d-b01fe0e2a896', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a01429-407e-4943-beb7-8ba533011618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a01429-407e-4943-beb7-8ba533011618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f559de59-5470-40d3-bdcf-6b1c6fbcc170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:50:20 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Volume 8459477c-42c2-4f0c-b93d-b01fe0e2a896: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8459477c-42c2-4f0c-b93d-b01fe0e2a896', 'volume_size': 1}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-197294408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8459477c-42c2-4f0c-b93d-b01fe0e2a896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8becb7fd97d41e187f8ec686d80d4de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:50:20Z,use_quota=True,user_id='9faf6082328c4469a5c45f254003022d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Creating volume 8459477c-42c2-4f0c-b93d-b01fe0e2a896 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:50:20 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8459477c-42c2-4f0c-b93d-b01fe0e2a896 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:50:20 devstack sudo[81167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8459477c-42c2-4f0c-b93d-b01fe0e2a896 1073741824
Nov 19 12:50:20 devstack sudo[81167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bcc861f-93d5-4f24-85cd-37111e4e1160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9ca56654-2444-449a-a91d-450cb1b4f257', 'volume_name': 'volume-9ca56654-2444-449a-a91d-450cb1b4f257', 'volume_size': 1, 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb13a00dd9444268988d63a8279e0575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5d491c17-c417-4a2b-886e-ad2958917626', 'created_at': datetime.datetime(2025, 11, 19, 11, 46, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 19, 11, 46, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d491c17-c417-4a2b-886e-ad2958917626/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbd1e33cfa0>}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f7a8d4-565d-4d45-af5e-dfe0de8365c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f7a8d4-565d-4d45-af5e-dfe0de8365c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6432503-6bf8-485b-ab6f-767bacae3044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:50:20 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Volume 9ca56654-2444-449a-a91d-450cb1b4f257: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9ca56654-2444-449a-a91d-450cb1b4f257', 'volume_size': 1, 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb13a00dd9444268988d63a8279e0575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5d491c17-c417-4a2b-886e-ad2958917626', 'created_at': datetime.datetime(2025, 11, 19, 11, 46, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 19, 11, 46, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d491c17-c417-4a2b-886e-ad2958917626/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbd1e33cfa0>}
Nov 19 12:50:20 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Cloning 9ca56654-2444-449a-a91d-450cb1b4f257 from image 5d491c17-c417-4a2b-886e-ad2958917626  at location (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]). {{(pid=80839) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Nov 19 12:50:21 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_b_mi3es7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=80839) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Nov 19 12:50:21 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Image download 20.69 MB at 20.69 MB/s
Nov 19 12:50:21 devstack cinder-volume[80839]: INFO oslo.privsep.daemon [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpbe_nemiw/privsep.sock']
Nov 19 12:50:21 devstack sudo[81505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpbe_nemiw/privsep.sock
Nov 19 12:50:21 devstack sudo[81505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:50:21 devstack sudo[81167]: pam_unix(sudo:session): session closed for user root
Nov 19 12:50:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8459477c-42c2-4f0c-b93d-b01fe0e2a896 1073741824" returned: 0 in 1.093s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:50:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8459477c-42c2-4f0c-b93d-b01fe0e2a896 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:50:21 devstack sudo[81541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8459477c-42c2-4f0c-b93d-b01fe0e2a896
Nov 19 12:50:21 devstack sudo[81541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:50:22 devstack sudo[81541]: pam_unix(sudo:session): session closed for user root
Nov 19 12:50:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8459477c-42c2-4f0c-b93d-b01fe0e2a896" returned: 0 in 0.875s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:50:22 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:50:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.980s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:50:22 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f559de59-5470-40d3-bdcf-6b1c6fbcc170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8459477c-42c2-4f0c-b93d-b01fe0e2a896', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:50:22 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0534af95-b18d-4139-8809-e268b78d0889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:50:22 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Volume volume-8459477c-42c2-4f0c-b93d-b01fe0e2a896 (8459477c-42c2-4f0c-b93d-b01fe0e2a896): created successfully
Nov 19 12:50:22 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0534af95-b18d-4139-8809-e268b78d0889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:50:22 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Flow 'volume_create_manager' (3aa3ff8d-003d-4fd5-a516-1d463b9608ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:50:22 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-ba8da391-e57a-4114-938c-8ec2e9182f7a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Created volume successfully.
Nov 19 12:50:23 devstack sudo[81505]: pam_unix(sudo:session): session closed for user root
Nov 19 12:50:23 devstack cinder-volume[80839]: INFO oslo.privsep.daemon [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Spawned new privsep daemon via rootwrap
Nov 19 12:50:23 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Accepted privsep connection to /tmp/tmpbe_nemiw/privsep.sock {{(pid=80839) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}}
Nov 19 12:50:23 devstack cinder-volume[80839]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 19 12:50:23 devstack cinder-volume[80839]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 19 12:50:23 devstack cinder-volume[80839]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 19 12:50:23 devstack cinder-volume[80839]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81550
Nov 19 12:50:23 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[538babf9-911f-4052-b710-4588f1f20e4f]: (2,) {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:50:23 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08c0d4b-dabe-47d5-afb3-aff40b28b63c]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:50:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_b_mi3es7devstack@QuobyteHD {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:50:23 devstack sudo[81552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_b_mi3es7devstack@QuobyteHD
Nov 19 12:50:23 devstack sudo[81552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:50:25 devstack sudo[81552]: pam_unix(sudo:session): session closed for user root
Nov 19 12:50:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_b_mi3es7devstack@QuobyteHD" returned: 0 in 1.674s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:50:25 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Temporary image 5d491c17-c417-4a2b-886e-ad2958917626 is fetched for user b388b8d4fdd243ebbc4ca4b8ea5c9e63. {{(pid=80839) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Nov 19 12:50:25 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[44620677-7111-479e-bd28-e6f9e0da1b91]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:50:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_b_mi3es7devstack@QuobyteHD {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:50:25 devstack sudo[81562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_b_mi3es7devstack@QuobyteHD
Nov 19 12:50:25 devstack sudo[81562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:50:26 devstack sudo[81562]: pam_unix(sudo:session): session closed for user root
Nov 19 12:50:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_b_mi3es7devstack@QuobyteHD" returned: 0 in 0.947s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:50:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:50:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:50:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1673872097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ca56654-2444-449a-a91d-450cb1b4f257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7154328a7b414c4db1b284597fccb90c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:50:20Z,use_quota=True,user_id='b388b8d4fdd243ebbc4ca4b8ea5c9e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:50:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Creating volume 9ca56654-2444-449a-a91d-450cb1b4f257 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:50:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:50:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:50:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:50:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:50:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:50:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:50:26 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:50:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:50:26 devstack sudo[81567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257 1073741824
Nov 19 12:50:26 devstack sudo[81567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:50:26 devstack sudo[81567]: pam_unix(sudo:session): session closed for user root
Nov 19 12:50:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257 1073741824" returned: 0 in 0.706s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:50:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:50:26 devstack sudo[81604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257
Nov 19 12:50:26 devstack sudo[81604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:50:27 devstack sudo[81604]: pam_unix(sudo:session): session closed for user root
Nov 19 12:50:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257" returned: 0 in 1.125s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:50:27 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:50:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:50:27 devstack cinder-volume[80839]: DEBUG cinder.volume.volume_utils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Attempting download of 5d491c17-c417-4a2b-886e-ad2958917626 ((None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}])) to volume 9ca56654-2444-449a-a91d-450cb1b4f257. {{(pid=80839) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Nov 19 12:50:27 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc355e4-9a48-4671-9e42-752ab061dbb9]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:50:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_vvchqtfm {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:50:28 devstack sudo[81656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_vvchqtfm
Nov 19 12:50:28 devstack sudo[81656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:50:28 devstack sudo[81656]: pam_unix(sudo:session): session closed for user root
Nov 19 12:50:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_vvchqtfm" returned: 0 in 0.716s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:50:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_vvchqtfm {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:50:28 devstack sudo[81660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_vvchqtfm
Nov 19 12:50:28 devstack sudo[81660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:50:29 devstack sudo[81660]: pam_unix(sudo:session): session closed for user root
Nov 19 12:50:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_vvchqtfm" returned: 1 in 1.035s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:50:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_vvchqtfm' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 12:50:29 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[def07000-a13d-43d1-9f5b-925055202cde]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:50:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_b_mi3es7devstack@QuobyteHD {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:50:29 devstack sudo[81666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_b_mi3es7devstack@QuobyteHD
Nov 19 12:50:29 devstack sudo[81666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:50:30 devstack sudo[81666]: pam_unix(sudo:session): session closed for user root
Nov 19 12:50:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_b_mi3es7devstack@QuobyteHD" returned: 0 in 0.930s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:50:30 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] 5d491c17-c417-4a2b-886e-ad2958917626 was qcow2, converting to raw {{(pid=80839) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Nov 19 12:50:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_b_mi3es7devstack@QuobyteHD /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:50:30 devstack sudo[81682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_b_mi3es7devstack@QuobyteHD /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257
Nov 19 12:50:30 devstack sudo[81682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:50:31 devstack sudo[81682]: pam_unix(sudo:session): session closed for user root
Nov 19 12:50:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_b_mi3es7devstack@QuobyteHD /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257" returned: 0 in 1.058s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:50:31 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_b_mi3es7devstack@QuobyteHD, size 112.00 MB, duration 1.06 sec, destination /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257 {{(pid=80839) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 19 12:50:31 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Converted 112.00 MB image at 105.76 MB/s
Nov 19 12:50:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:50:31 devstack sudo[81698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257 1G
Nov 19 12:50:31 devstack sudo[81698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:50:32 devstack sudo[81698]: pam_unix(sudo:session): session closed for user root
Nov 19 12:50:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257 1G" returned: 0 in 0.616s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:50:32 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9ecc8e-db0d-49ee-ab87-2f98f6988d1a]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:50:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:50:32 devstack sudo[81704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257
Nov 19 12:50:32 devstack sudo[81704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:50:33 devstack sudo[81704]: pam_unix(sudo:session): session closed for user root
Nov 19 12:50:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257" returned: 0 in 0.629s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:50:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:50:33 devstack sudo[81708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257
Nov 19 12:50:33 devstack sudo[81708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:50:33 devstack sudo[81708]: pam_unix(sudo:session): session closed for user root
Nov 19 12:50:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257" returned: 1 in 0.678s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:50:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 12:50:33 devstack cinder-volume[80839]: DEBUG cinder.volume.volume_utils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Downloaded image 5d491c17-c417-4a2b-886e-ad2958917626 ((None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}])) to volume 9ca56654-2444-449a-a91d-450cb1b4f257 successfully. {{(pid=80839) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Nov 19 12:50:33 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Temporary image 5d491c17-c417-4a2b-886e-ad2958917626 for user b388b8d4fdd243ebbc4ca4b8ea5c9e63 is deleted. {{(pid=80839) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Nov 19 12:50:33 devstack cinder-volume[80839]: DEBUG cinder.volume.volume_utils [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Marking volume 9ca56654-2444-449a-a91d-450cb1b4f257 as bootable. {{(pid=80839) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Nov 19 12:50:33 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Copying metadata from image 5d491c17-c417-4a2b-886e-ad2958917626 to 9ca56654-2444-449a-a91d-450cb1b4f257. {{(pid=80839) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 19 12:50:33 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Creating volume glance metadata for volume 9ca56654-2444-449a-a91d-450cb1b4f257 backed by image 5d491c17-c417-4a2b-886e-ad2958917626 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=80839) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 19 12:50:33 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6432503-6bf8-485b-ab6f-767bacae3044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ca56654-2444-449a-a91d-450cb1b4f257', 'volume_size': 1, 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb13a00dd9444268988d63a8279e0575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5d491c17-c417-4a2b-886e-ad2958917626', 'created_at': datetime.datetime(2025, 11, 19, 11, 46, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 19, 11, 46, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d491c17-c417-4a2b-886e-ad2958917626/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbd1e33cfa0>}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:50:33 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e29b2e89-7bbf-4e2f-94fe-e0421a43244d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:50:33 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Volume volume-9ca56654-2444-449a-a91d-450cb1b4f257 (9ca56654-2444-449a-a91d-450cb1b4f257): created successfully
Nov 19 12:50:33 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e29b2e89-7bbf-4e2f-94fe-e0421a43244d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:50:33 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Flow 'volume_create_manager' (c8871fa6-b580-4361-8f3e-7eaa8fdbca1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:50:33 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-f2dd020f-c38e-4b1d-8438-159f722c3cbb tempest-TaggedBootDevicesTest-2021980746 None] Created volume successfully.
Nov 19 12:50:35 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:50:35 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Flow 'volume_create_manager' (dd8e4c96-9eec-4df8-96f2-720a4b49b1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:50:35 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1908f464-e35d-46c4-aff3-c7c593122b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:50:35 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1908f464-e35d-46c4-aff3-c7c593122b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1968327508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07456408-21a1-4b5e-a351-97522507535c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7154328a7b414c4db1b284597fccb90c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:50:35Z,use_quota=True,user_id='b388b8d4fdd243ebbc4ca4b8ea5c9e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:50:35 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (def80b58-887b-4006-a408-2ff429aba36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:50:35 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (def80b58-887b-4006-a408-2ff429aba36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:50:35 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15282920-088b-4d9e-9c93-e723dd60326d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:50:35 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15282920-088b-4d9e-9c93-e723dd60326d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07456408-21a1-4b5e-a351-97522507535c', 'volume_name': 'volume-07456408-21a1-4b5e-a351-97522507535c', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:50:35 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00861c2-e250-40a8-9ebe-8f7c46e3514e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:50:35 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00861c2-e250-40a8-9ebe-8f7c46e3514e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:50:35 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b37f441-2373-4c7f-a934-922097e48edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:50:35 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Volume 07456408-21a1-4b5e-a351-97522507535c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07456408-21a1-4b5e-a351-97522507535c', 'volume_size': 1}
Nov 19 12:50:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:50:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:50:35 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1968327508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07456408-21a1-4b5e-a351-97522507535c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7154328a7b414c4db1b284597fccb90c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:50:35Z,use_quota=True,user_id='b388b8d4fdd243ebbc4ca4b8ea5c9e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:50:35 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Creating volume 07456408-21a1-4b5e-a351-97522507535c {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:50:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:50:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:50:35 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:50:35 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:50:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:50:35 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:50:35 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:50:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-07456408-21a1-4b5e-a351-97522507535c 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:50:35 devstack sudo[81720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-07456408-21a1-4b5e-a351-97522507535c 1073741824
Nov 19 12:50:35 devstack sudo[81720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:50:35 devstack sudo[81720]: pam_unix(sudo:session): session closed for user root
Nov 19 12:50:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-07456408-21a1-4b5e-a351-97522507535c 1073741824" returned: 0 in 0.756s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:50:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-07456408-21a1-4b5e-a351-97522507535c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:50:35 devstack sudo[81725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-07456408-21a1-4b5e-a351-97522507535c
Nov 19 12:50:35 devstack sudo[81725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:50:36 devstack sudo[81725]: pam_unix(sudo:session): session closed for user root
Nov 19 12:50:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-07456408-21a1-4b5e-a351-97522507535c" returned: 0 in 0.847s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:50:36 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:50:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:50:36 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b37f441-2373-4c7f-a934-922097e48edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07456408-21a1-4b5e-a351-97522507535c', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:50:36 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6daee5d1-037e-43b6-aa24-7966d9bb3c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:50:36 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Volume volume-07456408-21a1-4b5e-a351-97522507535c (07456408-21a1-4b5e-a351-97522507535c): created successfully
Nov 19 12:50:36 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6daee5d1-037e-43b6-aa24-7966d9bb3c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:50:36 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Flow 'volume_create_manager' (dd8e4c96-9eec-4df8-96f2-720a4b49b1a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:50:36 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-5a4f652f-a89b-4575-8bc8-b763ebdd1976 tempest-TaggedBootDevicesTest-2021980746 None] Created volume successfully.
Nov 19 12:50:37 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:50:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Flow 'volume_create_manager' (ed718fe5-518d-4f0c-a8df-4b12e80c4127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:50:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f536ae-e46e-4937-8cd4-06b259f6d614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:50:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f536ae-e46e-4937-8cd4-06b259f6d614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-562930115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a75369-8a0a-49b2-aec4-07c641dc1a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7154328a7b414c4db1b284597fccb90c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:50:37Z,use_quota=True,user_id='b388b8d4fdd243ebbc4ca4b8ea5c9e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:50:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d38ee757-6930-4bf4-96df-c7d321bbcf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:50:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d38ee757-6930-4bf4-96df-c7d321bbcf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:50:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b979b59-7c48-4273-905a-2947e9fb0d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:50:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b979b59-7c48-4273-905a-2947e9fb0d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31a75369-8a0a-49b2-aec4-07c641dc1a96', 'volume_name': 'volume-31a75369-8a0a-49b2-aec4-07c641dc1a96', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:50:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3653a5b-ea07-432a-bfd8-ab4bec5aec90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:50:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3653a5b-ea07-432a-bfd8-ab4bec5aec90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:50:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5459b906-7b44-4039-b32d-3302da86a84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:50:37 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Volume 31a75369-8a0a-49b2-aec4-07c641dc1a96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31a75369-8a0a-49b2-aec4-07c641dc1a96', 'volume_size': 1}
Nov 19 12:50:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:50:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:50:37 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-562930115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a75369-8a0a-49b2-aec4-07c641dc1a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7154328a7b414c4db1b284597fccb90c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:50:37Z,use_quota=True,user_id='b388b8d4fdd243ebbc4ca4b8ea5c9e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:50:37 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Creating volume 31a75369-8a0a-49b2-aec4-07c641dc1a96 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:50:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:50:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:50:37 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:50:37 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:50:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:50:37 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:50:37 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:50:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31a75369-8a0a-49b2-aec4-07c641dc1a96 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:50:37 devstack sudo[81756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31a75369-8a0a-49b2-aec4-07c641dc1a96 1073741824
Nov 19 12:50:37 devstack sudo[81756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:50:38 devstack sudo[81756]: pam_unix(sudo:session): session closed for user root
Nov 19 12:50:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31a75369-8a0a-49b2-aec4-07c641dc1a96 1073741824" returned: 0 in 0.860s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:50:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31a75369-8a0a-49b2-aec4-07c641dc1a96 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:50:38 devstack sudo[81772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31a75369-8a0a-49b2-aec4-07c641dc1a96
Nov 19 12:50:38 devstack sudo[81772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:50:39 devstack sudo[81772]: pam_unix(sudo:session): session closed for user root
Nov 19 12:50:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31a75369-8a0a-49b2-aec4-07c641dc1a96" returned: 0 in 0.576s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:50:39 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:50:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:50:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5459b906-7b44-4039-b32d-3302da86a84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31a75369-8a0a-49b2-aec4-07c641dc1a96', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:50:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2831331-e81f-4d62-96ec-cc5172ec07f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:50:39 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Volume volume-31a75369-8a0a-49b2-aec4-07c641dc1a96 (31a75369-8a0a-49b2-aec4-07c641dc1a96): created successfully
Nov 19 12:50:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2831331-e81f-4d62-96ec-cc5172ec07f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:50:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Flow 'volume_create_manager' (ed718fe5-518d-4f0c-a8df-4b12e80c4127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:50:39 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-53f09e0f-da56-4ead-a1ea-f6a848d047f1 tempest-TaggedBootDevicesTest-2021980746 None] Created volume successfully.
Nov 19 12:50:49 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:UPDATE=10,cinder:SELECT=17,cinder:DELETE=1,cinder:INSERT=13 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:50:49 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:DELETE=3 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:51:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-dedcfb8d-7ac8-4d0d-8c8d-8fa5b02c29c0 req-9038e6f3-87b4-472c-b823-f5c13f1f73b0 tempest-TaggedBootDevicesTest-2021980746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:51:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-dedcfb8d-7ac8-4d0d-8c8d-8fa5b02c29c0 req-9038e6f3-87b4-472c-b823-f5c13f1f73b0 tempest-TaggedBootDevicesTest-2021980746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:51:01 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5cdaf6-4054-49de-aacf-f98c03209c0b]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:51:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-dedcfb8d-7ac8-4d0d-8c8d-8fa5b02c29c0 req-9038e6f3-87b4-472c-b823-f5c13f1f73b0 tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:51:01 devstack sudo[81903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257
Nov 19 12:51:01 devstack sudo[81903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:51:02 devstack sudo[81903]: pam_unix(sudo:session): session closed for user root
Nov 19 12:51:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-dedcfb8d-7ac8-4d0d-8c8d-8fa5b02c29c0 req-9038e6f3-87b4-472c-b823-f5c13f1f73b0 tempest-TaggedBootDevicesTest-2021980746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257" returned: 0 in 0.683s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:51:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-dedcfb8d-7ac8-4d0d-8c8d-8fa5b02c29c0 req-9038e6f3-87b4-472c-b823-f5c13f1f73b0 tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:51:02 devstack sudo[81913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257
Nov 19 12:51:02 devstack sudo[81913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:51:02 devstack sudo[81913]: pam_unix(sudo:session): session closed for user root
Nov 19 12:51:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-dedcfb8d-7ac8-4d0d-8c8d-8fa5b02c29c0 req-9038e6f3-87b4-472c-b823-f5c13f1f73b0 tempest-TaggedBootDevicesTest-2021980746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257" returned: 1 in 0.577s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:51:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-dedcfb8d-7ac8-4d0d-8c8d-8fa5b02c29c0 req-9038e6f3-87b4-472c-b823-f5c13f1f73b0 tempest-TaggedBootDevicesTest-2021980746 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 12:51:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-dedcfb8d-7ac8-4d0d-8c8d-8fa5b02c29c0 req-9038e6f3-87b4-472c-b823-f5c13f1f73b0 tempest-TaggedBootDevicesTest-2021980746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.289s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:51:03 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-dedcfb8d-7ac8-4d0d-8c8d-8fa5b02c29c0 req-9038e6f3-87b4-472c-b823-f5c13f1f73b0 tempest-TaggedBootDevicesTest-2021980746 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-9ca56654-2444-449a-a91d-450cb1b4f257', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a210e676-93c5-4ce8-93fb-b68f614b4984', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 12:51:03 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-dedcfb8d-7ac8-4d0d-8c8d-8fa5b02c29c0 req-9038e6f3-87b4-472c-b823-f5c13f1f73b0 tempest-TaggedBootDevicesTest-2021980746 None] attachment_update completed successfully.
Nov 19 12:51:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 12:51:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:51:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:51:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:51:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:51:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:51:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:51:04 devstack sudo[81928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:51:04 devstack sudo[81928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:51:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-dedcfb8d-7ac8-4d0d-8c8d-8fa5b02c29c0 req-e8f1d5a3-8083-4034-a8d8-a2d2789aba29 tempest-TaggedBootDevicesTest-2021980746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:51:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-dedcfb8d-7ac8-4d0d-8c8d-8fa5b02c29c0 req-e8f1d5a3-8083-4034-a8d8-a2d2789aba29 tempest-TaggedBootDevicesTest-2021980746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:51:04 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5542b164-8b3f-42ae-b126-3b7265a153a6]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:51:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-dedcfb8d-7ac8-4d0d-8c8d-8fa5b02c29c0 req-e8f1d5a3-8083-4034-a8d8-a2d2789aba29 tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-07456408-21a1-4b5e-a351-97522507535c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:51:04 devstack sudo[81930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-07456408-21a1-4b5e-a351-97522507535c
Nov 19 12:51:04 devstack sudo[81930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:51:05 devstack sudo[81930]: pam_unix(sudo:session): session closed for user root
Nov 19 12:51:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-dedcfb8d-7ac8-4d0d-8c8d-8fa5b02c29c0 req-e8f1d5a3-8083-4034-a8d8-a2d2789aba29 tempest-TaggedBootDevicesTest-2021980746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-07456408-21a1-4b5e-a351-97522507535c" returned: 0 in 0.653s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:51:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-dedcfb8d-7ac8-4d0d-8c8d-8fa5b02c29c0 req-e8f1d5a3-8083-4034-a8d8-a2d2789aba29 tempest-TaggedBootDevicesTest-2021980746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.662s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:51:05 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-dedcfb8d-7ac8-4d0d-8c8d-8fa5b02c29c0 req-e8f1d5a3-8083-4034-a8d8-a2d2789aba29 tempest-TaggedBootDevicesTest-2021980746 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-07456408-21a1-4b5e-a351-97522507535c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a1d43e0f-869e-4c2d-a266-7d082c14bb34', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 12:51:05 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-dedcfb8d-7ac8-4d0d-8c8d-8fa5b02c29c0 req-e8f1d5a3-8083-4034-a8d8-a2d2789aba29 tempest-TaggedBootDevicesTest-2021980746 None] attachment_update completed successfully.
Nov 19 12:51:05 devstack sudo[81928]: pam_unix(sudo:session): session closed for user root
Nov 19 12:51:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.850s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:51:05 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:51:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-dedcfb8d-7ac8-4d0d-8c8d-8fa5b02c29c0 req-e2ac2403-344f-48db-a06c-6b35649d6cc3 tempest-TaggedBootDevicesTest-2021980746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:51:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-dedcfb8d-7ac8-4d0d-8c8d-8fa5b02c29c0 req-e2ac2403-344f-48db-a06c-6b35649d6cc3 tempest-TaggedBootDevicesTest-2021980746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:51:07 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c02590-b2a1-40aa-bdb2-0de8be0017d4]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:51:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-dedcfb8d-7ac8-4d0d-8c8d-8fa5b02c29c0 req-e2ac2403-344f-48db-a06c-6b35649d6cc3 tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31a75369-8a0a-49b2-aec4-07c641dc1a96 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:51:07 devstack sudo[82000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31a75369-8a0a-49b2-aec4-07c641dc1a96
Nov 19 12:51:07 devstack sudo[82000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:51:08 devstack sudo[82000]: pam_unix(sudo:session): session closed for user root
Nov 19 12:51:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-dedcfb8d-7ac8-4d0d-8c8d-8fa5b02c29c0 req-e2ac2403-344f-48db-a06c-6b35649d6cc3 tempest-TaggedBootDevicesTest-2021980746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31a75369-8a0a-49b2-aec4-07c641dc1a96" returned: 0 in 0.903s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:51:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-dedcfb8d-7ac8-4d0d-8c8d-8fa5b02c29c0 req-e2ac2403-344f-48db-a06c-6b35649d6cc3 tempest-TaggedBootDevicesTest-2021980746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.936s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:51:08 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-dedcfb8d-7ac8-4d0d-8c8d-8fa5b02c29c0 req-e2ac2403-344f-48db-a06c-6b35649d6cc3 tempest-TaggedBootDevicesTest-2021980746 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-31a75369-8a0a-49b2-aec4-07c641dc1a96', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9891e45-4503-47bf-96b4-1fa1866b4400', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 12:51:08 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-dedcfb8d-7ac8-4d0d-8c8d-8fa5b02c29c0 req-e2ac2403-344f-48db-a06c-6b35649d6cc3 tempest-TaggedBootDevicesTest-2021980746 None] attachment_update completed successfully.
Nov 19 12:51:11 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:51:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Flow 'volume_create_manager' (24aefcb5-2f66-4a06-9313-68195f0c7e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:51:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ed408f1-38be-45fc-8532-0663347a0f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:51:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ed408f1-38be-45fc-8532-0663347a0f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1793364645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48df5d7d-94f1-4e75-9d86-ed681e01e7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821948c577c5469e8072934f93eda8ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:51:11Z,use_quota=True,user_id='8f7fa045f78543158dc525ca105adbb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:51:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2728f4d0-7369-4078-b293-e155953c1ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:51:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2728f4d0-7369-4078-b293-e155953c1ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:51:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec9b1e7-5130-4937-a38c-66fd1475470e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:51:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec9b1e7-5130-4937-a38c-66fd1475470e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48df5d7d-94f1-4e75-9d86-ed681e01e7c7', 'volume_name': 'volume-48df5d7d-94f1-4e75-9d86-ed681e01e7c7', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:51:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b1fec2-c812-4f03-bf92-4848034e0766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:51:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b1fec2-c812-4f03-bf92-4848034e0766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:51:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc98076c-8a27-4692-bb7e-bc207d8b8d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:51:11 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Volume 48df5d7d-94f1-4e75-9d86-ed681e01e7c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48df5d7d-94f1-4e75-9d86-ed681e01e7c7', 'volume_size': 1}
Nov 19 12:51:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:51:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:51:11 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1793364645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48df5d7d-94f1-4e75-9d86-ed681e01e7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821948c577c5469e8072934f93eda8ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:51:11Z,use_quota=True,user_id='8f7fa045f78543158dc525ca105adbb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:51:11 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Creating volume 48df5d7d-94f1-4e75-9d86-ed681e01e7c7 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:51:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:51:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:51:11 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:51:11 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:51:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:51:11 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:51:11 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:51:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-48df5d7d-94f1-4e75-9d86-ed681e01e7c7 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:51:11 devstack sudo[82018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-48df5d7d-94f1-4e75-9d86-ed681e01e7c7 1073741824
Nov 19 12:51:11 devstack sudo[82018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:51:12 devstack sudo[82018]: pam_unix(sudo:session): session closed for user root
Nov 19 12:51:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-48df5d7d-94f1-4e75-9d86-ed681e01e7c7 1073741824" returned: 0 in 0.708s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:51:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-48df5d7d-94f1-4e75-9d86-ed681e01e7c7 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:51:12 devstack sudo[82024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-48df5d7d-94f1-4e75-9d86-ed681e01e7c7
Nov 19 12:51:12 devstack sudo[82024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:51:12 devstack sudo[82024]: pam_unix(sudo:session): session closed for user root
Nov 19 12:51:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-48df5d7d-94f1-4e75-9d86-ed681e01e7c7" returned: 0 in 0.567s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:51:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:51:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:51:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc98076c-8a27-4692-bb7e-bc207d8b8d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48df5d7d-94f1-4e75-9d86-ed681e01e7c7', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:51:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d846b8-10e0-4624-85b9-6b177eb1534e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:51:12 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Volume volume-48df5d7d-94f1-4e75-9d86-ed681e01e7c7 (48df5d7d-94f1-4e75-9d86-ed681e01e7c7): created successfully
Nov 19 12:51:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d846b8-10e0-4624-85b9-6b177eb1534e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:51:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Flow 'volume_create_manager' (24aefcb5-2f66-4a06-9313-68195f0c7e2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:51:12 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-3d2d79cb-5a5b-4d2d-8230-61d2da181f68 tempest-VolumesAdminNegativeTest-1140383892 None] Created volume successfully.
Nov 19 12:51:14 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-72f52f17-8b9b-4162-9b3f-b3c34c176532 tempest-VolumesAdminNegativeTest-1140383892 None] Acquiring lock "cinder-48df5d7d-94f1-4e75-9d86-ed681e01e7c7-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:51:14 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-72f52f17-8b9b-4162-9b3f-b3c34c176532 tempest-VolumesAdminNegativeTest-1140383892 None] Lock "cinder-48df5d7d-94f1-4e75-9d86-ed681e01e7c7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:51:14 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-72f52f17-8b9b-4162-9b3f-b3c34c176532 tempest-VolumesAdminNegativeTest-1140383892 None] Acquiring lock "cinder-quobyte-48df5d7d-94f1-4e75-9d86-ed681e01e7c7" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:51:14 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-72f52f17-8b9b-4162-9b3f-b3c34c176532 tempest-VolumesAdminNegativeTest-1140383892 None] Lock "cinder-quobyte-48df5d7d-94f1-4e75-9d86-ed681e01e7c7" acquired by "delete_volume" :: waited 0.024s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:51:14 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf493ef-2448-4986-8beb-59379146451f]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:51:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-72f52f17-8b9b-4162-9b3f-b3c34c176532 tempest-VolumesAdminNegativeTest-1140383892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-48df5d7d-94f1-4e75-9d86-ed681e01e7c7 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:51:14 devstack sudo[82030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-48df5d7d-94f1-4e75-9d86-ed681e01e7c7
Nov 19 12:51:14 devstack sudo[82030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:51:14 devstack sudo[82030]: pam_unix(sudo:session): session closed for user root
Nov 19 12:51:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-72f52f17-8b9b-4162-9b3f-b3c34c176532 tempest-VolumesAdminNegativeTest-1140383892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-48df5d7d-94f1-4e75-9d86-ed681e01e7c7" returned: 0 in 0.686s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:51:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-72f52f17-8b9b-4162-9b3f-b3c34c176532 tempest-VolumesAdminNegativeTest-1140383892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-48df5d7d-94f1-4e75-9d86-ed681e01e7c7 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:51:14 devstack sudo[82037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-48df5d7d-94f1-4e75-9d86-ed681e01e7c7
Nov 19 12:51:14 devstack sudo[82037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:51:15 devstack sudo[82037]: pam_unix(sudo:session): session closed for user root
Nov 19 12:51:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-72f52f17-8b9b-4162-9b3f-b3c34c176532 tempest-VolumesAdminNegativeTest-1140383892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-48df5d7d-94f1-4e75-9d86-ed681e01e7c7" returned: 0 in 0.455s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:51:15 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-72f52f17-8b9b-4162-9b3f-b3c34c176532 tempest-VolumesAdminNegativeTest-1140383892 None] Lock "cinder-quobyte-48df5d7d-94f1-4e75-9d86-ed681e01e7c7" released by "delete_volume" :: held 1.240s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:51:15 devstack cinder-volume[80839]: WARNING cinder.quota [None req-72f52f17-8b9b-4162-9b3f-b3c34c176532 tempest-VolumesAdminNegativeTest-1140383892 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 19 12:51:15 devstack cinder-volume[80839]: WARNING cinder.quota [None req-72f52f17-8b9b-4162-9b3f-b3c34c176532 tempest-VolumesAdminNegativeTest-1140383892 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 19 12:51:15 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-72f52f17-8b9b-4162-9b3f-b3c34c176532 tempest-VolumesAdminNegativeTest-1140383892 None] Created reservations ['270e0048-58b2-44b0-a3e0-39065738a39f', 'f7fe4c83-ab81-4a75-bdd2-6882a6809ad1', 'cc34a61b-d113-4019-8540-dbbc3afb34b1', '9b4e4d70-6859-41b5-850e-7d64e7d557ad'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:51:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-72f52f17-8b9b-4162-9b3f-b3c34c176532 tempest-VolumesAdminNegativeTest-1140383892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:51:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-72f52f17-8b9b-4162-9b3f-b3c34c176532 tempest-VolumesAdminNegativeTest-1140383892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:51:15 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-72f52f17-8b9b-4162-9b3f-b3c34c176532 tempest-VolumesAdminNegativeTest-1140383892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:51:15 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-72f52f17-8b9b-4162-9b3f-b3c34c176532 tempest-VolumesAdminNegativeTest-1140383892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:51:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-72f52f17-8b9b-4162-9b3f-b3c34c176532 tempest-VolumesAdminNegativeTest-1140383892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:51:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-72f52f17-8b9b-4162-9b3f-b3c34c176532 tempest-VolumesAdminNegativeTest-1140383892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:51:15 devstack sudo[82043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:51:15 devstack sudo[82043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:51:16 devstack sudo[82043]: pam_unix(sudo:session): session closed for user root
Nov 19 12:51:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-72f52f17-8b9b-4162-9b3f-b3c34c176532 tempest-VolumesAdminNegativeTest-1140383892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.646s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:51:16 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-72f52f17-8b9b-4162-9b3f-b3c34c176532 tempest-VolumesAdminNegativeTest-1140383892 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:51:16 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-72f52f17-8b9b-4162-9b3f-b3c34c176532 tempest-VolumesAdminNegativeTest-1140383892 None] Deleted volume successfully.
Nov 19 12:51:16 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-72f52f17-8b9b-4162-9b3f-b3c34c176532 tempest-VolumesAdminNegativeTest-1140383892 None] Lock "cinder-48df5d7d-94f1-4e75-9d86-ed681e01e7c7-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:51:30 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=24,cinder:UPDATE=14,cinder:INSERT=2 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:51:30 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=22,cinder:UPDATE=16,cinder:DELETE=2,cinder:INSERT=2 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:51:30 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:51:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Flow 'volume_create_manager' (41b15c26-18bf-496c-9495-ea0610033346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:51:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5be8ad-cdd2-4da8-aea1-16bb40842a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:51:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5be8ad-cdd2-4da8-aea1-16bb40842a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1752921853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea00207a-01d8-4d06-92cb-59576c534add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ece9ec09a2741d7848701705d1da1e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:51:31Z,use_quota=True,user_id='d8ebb28cba9b4c66963d0198ce286c22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:51:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4e1aab-31d7-4a15-bd8b-f1d2e67fdda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:51:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4e1aab-31d7-4a15-bd8b-f1d2e67fdda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:51:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eeb9b72-466b-4fe4-9488-fcca9538494c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:51:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eeb9b72-466b-4fe4-9488-fcca9538494c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea00207a-01d8-4d06-92cb-59576c534add', 'volume_name': 'volume-ea00207a-01d8-4d06-92cb-59576c534add', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:51:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcdd0689-91c6-43bc-bc33-906800aeaef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:51:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcdd0689-91c6-43bc-bc33-906800aeaef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:51:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8d01df-6beb-44ac-b868-0248af017e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:51:30 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Volume ea00207a-01d8-4d06-92cb-59576c534add: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea00207a-01d8-4d06-92cb-59576c534add', 'volume_size': 1}
Nov 19 12:51:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:51:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:51:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1752921853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea00207a-01d8-4d06-92cb-59576c534add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ece9ec09a2741d7848701705d1da1e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:51:31Z,use_quota=True,user_id='d8ebb28cba9b4c66963d0198ce286c22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:51:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Creating volume ea00207a-01d8-4d06-92cb-59576c534add {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:51:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:51:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:51:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:51:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:51:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:51:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:51:30 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:51:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ea00207a-01d8-4d06-92cb-59576c534add 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:51:30 devstack sudo[82862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ea00207a-01d8-4d06-92cb-59576c534add 1073741824
Nov 19 12:51:30 devstack sudo[82862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:51:31 devstack sudo[82862]: pam_unix(sudo:session): session closed for user root
Nov 19 12:51:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ea00207a-01d8-4d06-92cb-59576c534add 1073741824" returned: 0 in 0.807s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:51:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ea00207a-01d8-4d06-92cb-59576c534add {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:51:31 devstack sudo[82868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ea00207a-01d8-4d06-92cb-59576c534add
Nov 19 12:51:31 devstack sudo[82868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:51:32 devstack sudo[82868]: pam_unix(sudo:session): session closed for user root
Nov 19 12:51:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ea00207a-01d8-4d06-92cb-59576c534add" returned: 0 in 0.513s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:51:32 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:51:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:51:32 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8d01df-6beb-44ac-b868-0248af017e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea00207a-01d8-4d06-92cb-59576c534add', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:51:32 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b0528c-c51a-4c5f-b18b-9afb3e1a3eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:51:32 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Volume volume-ea00207a-01d8-4d06-92cb-59576c534add (ea00207a-01d8-4d06-92cb-59576c534add): created successfully
Nov 19 12:51:32 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b0528c-c51a-4c5f-b18b-9afb3e1a3eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:51:32 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Flow 'volume_create_manager' (41b15c26-18bf-496c-9495-ea0610033346) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:51:32 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-40cf6fa0-a945-43e2-9865-2392b00a895e tempest-AttachSCSIVolumeTestJSON-1575302346 None] Created volume successfully.
Nov 19 12:51:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-5e12532b-657f-41ca-b911-b636c02485b1 req-8071989e-fe5f-41d2-8b33-f4a65f9608e2 tempest-AttachSCSIVolumeTestJSON-1575302346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:51:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-5e12532b-657f-41ca-b911-b636c02485b1 req-8071989e-fe5f-41d2-8b33-f4a65f9608e2 tempest-AttachSCSIVolumeTestJSON-1575302346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:51:35 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b81411-bd47-42c3-b909-61983bb3aa97]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:51:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-5e12532b-657f-41ca-b911-b636c02485b1 req-8071989e-fe5f-41d2-8b33-f4a65f9608e2 tempest-AttachSCSIVolumeTestJSON-1575302346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ea00207a-01d8-4d06-92cb-59576c534add {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:51:36 devstack sudo[82904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ea00207a-01d8-4d06-92cb-59576c534add
Nov 19 12:51:36 devstack sudo[82904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:51:36 devstack sudo[82904]: pam_unix(sudo:session): session closed for user root
Nov 19 12:51:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-5e12532b-657f-41ca-b911-b636c02485b1 req-8071989e-fe5f-41d2-8b33-f4a65f9608e2 tempest-AttachSCSIVolumeTestJSON-1575302346 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ea00207a-01d8-4d06-92cb-59576c534add" returned: 0 in 0.646s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:51:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-5e12532b-657f-41ca-b911-b636c02485b1 req-8071989e-fe5f-41d2-8b33-f4a65f9608e2 tempest-AttachSCSIVolumeTestJSON-1575302346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.694s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:51:36 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-5e12532b-657f-41ca-b911-b636c02485b1 req-8071989e-fe5f-41d2-8b33-f4a65f9608e2 tempest-AttachSCSIVolumeTestJSON-1575302346 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-ea00207a-01d8-4d06-92cb-59576c534add', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b95b372-96b6-4584-b8d6-c47a51c5ef54', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 12:51:36 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-5e12532b-657f-41ca-b911-b636c02485b1 req-8071989e-fe5f-41d2-8b33-f4a65f9608e2 tempest-AttachSCSIVolumeTestJSON-1575302346 None] attachment_update completed successfully.
Nov 19 12:51:42 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-df2f0ad0-f0a1-4f24-94c7-fa035a12c1ed req-0e0a3c86-8a32-4a4d-8bac-63c9a68bb92a tempest-AttachSCSIVolumeTestJSON-1575302346 None] Terminate volume connection completed successfully.
Nov 19 12:51:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-df2f0ad0-f0a1-4f24-94c7-fa035a12c1ed req-0e0a3c86-8a32-4a4d-8bac-63c9a68bb92a tempest-AttachSCSIVolumeTestJSON-1575302346 None] Deleting attachment 7b95b372-96b6-4584-b8d6-c47a51c5ef54. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 12:51:46 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=8,cinder:UPDATE=5 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:51:52 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:UPDATE=2,cinder:SELECT=7,cinder:DELETE=1 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:51:53 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-cf8f1a34-d18e-44cb-8e54-6fa2c0c1200f tempest-AttachSCSIVolumeTestJSON-1575302346 None] Acquiring lock "cinder-ea00207a-01d8-4d06-92cb-59576c534add-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:51:53 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-cf8f1a34-d18e-44cb-8e54-6fa2c0c1200f tempest-AttachSCSIVolumeTestJSON-1575302346 None] Lock "cinder-ea00207a-01d8-4d06-92cb-59576c534add-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:51:53 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-cf8f1a34-d18e-44cb-8e54-6fa2c0c1200f tempest-AttachSCSIVolumeTestJSON-1575302346 None] Acquiring lock "cinder-quobyte-ea00207a-01d8-4d06-92cb-59576c534add" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:51:53 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-cf8f1a34-d18e-44cb-8e54-6fa2c0c1200f tempest-AttachSCSIVolumeTestJSON-1575302346 None] Lock "cinder-quobyte-ea00207a-01d8-4d06-92cb-59576c534add" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:51:53 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f542cb-ed4b-4c93-9b9d-f9b03fd0e725]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:51:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cf8f1a34-d18e-44cb-8e54-6fa2c0c1200f tempest-AttachSCSIVolumeTestJSON-1575302346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ea00207a-01d8-4d06-92cb-59576c534add {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:51:53 devstack sudo[83049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ea00207a-01d8-4d06-92cb-59576c534add
Nov 19 12:51:53 devstack sudo[83049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:51:53 devstack sudo[83049]: pam_unix(sudo:session): session closed for user root
Nov 19 12:51:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cf8f1a34-d18e-44cb-8e54-6fa2c0c1200f tempest-AttachSCSIVolumeTestJSON-1575302346 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ea00207a-01d8-4d06-92cb-59576c534add" returned: 0 in 0.597s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:51:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cf8f1a34-d18e-44cb-8e54-6fa2c0c1200f tempest-AttachSCSIVolumeTestJSON-1575302346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ea00207a-01d8-4d06-92cb-59576c534add {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:51:53 devstack sudo[83054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ea00207a-01d8-4d06-92cb-59576c534add
Nov 19 12:51:53 devstack sudo[83054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:51:54 devstack sudo[83054]: pam_unix(sudo:session): session closed for user root
Nov 19 12:51:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cf8f1a34-d18e-44cb-8e54-6fa2c0c1200f tempest-AttachSCSIVolumeTestJSON-1575302346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ea00207a-01d8-4d06-92cb-59576c534add" returned: 0 in 0.463s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:51:54 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-cf8f1a34-d18e-44cb-8e54-6fa2c0c1200f tempest-AttachSCSIVolumeTestJSON-1575302346 None] Lock "cinder-quobyte-ea00207a-01d8-4d06-92cb-59576c534add" released by "delete_volume" :: held 1.083s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:51:54 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-cf8f1a34-d18e-44cb-8e54-6fa2c0c1200f tempest-AttachSCSIVolumeTestJSON-1575302346 None] Created reservations ['79688975-0cb0-445b-8455-3d15f834520b', '1aae47f6-4dcb-4274-89e7-1c7cb6cb443b', '71122629-1fad-44bc-bec3-f06fdbcf67a0', '901191cd-7aa3-4706-baf5-bb3555812ab1'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:51:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cf8f1a34-d18e-44cb-8e54-6fa2c0c1200f tempest-AttachSCSIVolumeTestJSON-1575302346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:51:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cf8f1a34-d18e-44cb-8e54-6fa2c0c1200f tempest-AttachSCSIVolumeTestJSON-1575302346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:51:54 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-cf8f1a34-d18e-44cb-8e54-6fa2c0c1200f tempest-AttachSCSIVolumeTestJSON-1575302346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:51:54 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-cf8f1a34-d18e-44cb-8e54-6fa2c0c1200f tempest-AttachSCSIVolumeTestJSON-1575302346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:51:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cf8f1a34-d18e-44cb-8e54-6fa2c0c1200f tempest-AttachSCSIVolumeTestJSON-1575302346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:51:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cf8f1a34-d18e-44cb-8e54-6fa2c0c1200f tempest-AttachSCSIVolumeTestJSON-1575302346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:51:54 devstack sudo[83062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:51:54 devstack sudo[83062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:51:54 devstack sudo[83062]: pam_unix(sudo:session): session closed for user root
Nov 19 12:51:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cf8f1a34-d18e-44cb-8e54-6fa2c0c1200f tempest-AttachSCSIVolumeTestJSON-1575302346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.488s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:51:54 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-cf8f1a34-d18e-44cb-8e54-6fa2c0c1200f tempest-AttachSCSIVolumeTestJSON-1575302346 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:51:54 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-cf8f1a34-d18e-44cb-8e54-6fa2c0c1200f tempest-AttachSCSIVolumeTestJSON-1575302346 None] Deleted volume successfully.
Nov 19 12:51:54 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-cf8f1a34-d18e-44cb-8e54-6fa2c0c1200f tempest-AttachSCSIVolumeTestJSON-1575302346 None] Lock "cinder-ea00207a-01d8-4d06-92cb-59576c534add-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:51:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-14693f9a-67e3-4527-94ac-51360364a7e5 req-839d1703-4f7f-4b06-aac8-557b6c9ef14a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:51:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-14693f9a-67e3-4527-94ac-51360364a7e5 req-839d1703-4f7f-4b06-aac8-557b6c9ef14a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:51:58 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1f9db9-feff-4b9a-9f54-1eb50bb204c9]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:51:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-14693f9a-67e3-4527-94ac-51360364a7e5 req-839d1703-4f7f-4b06-aac8-557b6c9ef14a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8459477c-42c2-4f0c-b93d-b01fe0e2a896 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:51:58 devstack sudo[83157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8459477c-42c2-4f0c-b93d-b01fe0e2a896
Nov 19 12:51:58 devstack sudo[83157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:51:59 devstack sudo[83157]: pam_unix(sudo:session): session closed for user root
Nov 19 12:51:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-14693f9a-67e3-4527-94ac-51360364a7e5 req-839d1703-4f7f-4b06-aac8-557b6c9ef14a tempest-VolumesAssistedSnapshotsTest-1046434315 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8459477c-42c2-4f0c-b93d-b01fe0e2a896" returned: 0 in 0.958s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:51:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-14693f9a-67e3-4527-94ac-51360364a7e5 req-839d1703-4f7f-4b06-aac8-557b6c9ef14a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.996s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:51:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-14693f9a-67e3-4527-94ac-51360364a7e5 req-839d1703-4f7f-4b06-aac8-557b6c9ef14a tempest-VolumesAssistedSnapshotsTest-1046434315 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-8459477c-42c2-4f0c-b93d-b01fe0e2a896', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8732a72-1a7b-45fb-88c2-901d9377b519', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 12:51:59 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-14693f9a-67e3-4527-94ac-51360364a7e5 req-839d1703-4f7f-4b06-aac8-557b6c9ef14a tempest-VolumesAssistedSnapshotsTest-1046434315 None] attachment_update completed successfully.
Nov 19 12:52:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 12:52:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:52:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:52:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:52:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:52:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:52:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:04 devstack sudo[83172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:52:04 devstack sudo[83172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:05 devstack sudo[83172]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 1.059s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:05 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:52:08 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-cb301296-9826-48db-8a7a-5fc307c48d0e req-1876d0eb-4b5e-4b2d-9195-1dff5436182b tempest-VolumesAssistedSnapshotsTest-1046434315 None] Terminate volume connection completed successfully.
Nov 19 12:52:08 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-cb301296-9826-48db-8a7a-5fc307c48d0e req-1876d0eb-4b5e-4b2d-9195-1dff5436182b tempest-VolumesAssistedSnapshotsTest-1046434315 None] Deleting attachment c8732a72-1a7b-45fb-88c2-901d9377b519. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 12:52:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9f256969-fa9d-4e65-a493-ec82f3bee898 tempest-VolumesAssistedSnapshotsTest-1046434315 None] Acquiring lock "cinder-8459477c-42c2-4f0c-b93d-b01fe0e2a896-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:52:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9f256969-fa9d-4e65-a493-ec82f3bee898 tempest-VolumesAssistedSnapshotsTest-1046434315 None] Lock "cinder-8459477c-42c2-4f0c-b93d-b01fe0e2a896-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:52:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9f256969-fa9d-4e65-a493-ec82f3bee898 tempest-VolumesAssistedSnapshotsTest-1046434315 None] Acquiring lock "cinder-quobyte-8459477c-42c2-4f0c-b93d-b01fe0e2a896" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:52:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9f256969-fa9d-4e65-a493-ec82f3bee898 tempest-VolumesAssistedSnapshotsTest-1046434315 None] Lock "cinder-quobyte-8459477c-42c2-4f0c-b93d-b01fe0e2a896" acquired by "delete_volume" :: waited 0.016s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:52:10 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[609d69bc-473f-4049-8cf3-bb204a345338]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:52:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f256969-fa9d-4e65-a493-ec82f3bee898 tempest-VolumesAssistedSnapshotsTest-1046434315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8459477c-42c2-4f0c-b93d-b01fe0e2a896 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:10 devstack sudo[83193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8459477c-42c2-4f0c-b93d-b01fe0e2a896
Nov 19 12:52:10 devstack sudo[83193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:11 devstack sudo[83193]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f256969-fa9d-4e65-a493-ec82f3bee898 tempest-VolumesAssistedSnapshotsTest-1046434315 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8459477c-42c2-4f0c-b93d-b01fe0e2a896" returned: 0 in 0.936s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f256969-fa9d-4e65-a493-ec82f3bee898 tempest-VolumesAssistedSnapshotsTest-1046434315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8459477c-42c2-4f0c-b93d-b01fe0e2a896 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:11 devstack sudo[83201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8459477c-42c2-4f0c-b93d-b01fe0e2a896
Nov 19 12:52:11 devstack sudo[83201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:12 devstack sudo[83201]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f256969-fa9d-4e65-a493-ec82f3bee898 tempest-VolumesAssistedSnapshotsTest-1046434315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8459477c-42c2-4f0c-b93d-b01fe0e2a896" returned: 0 in 0.740s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9f256969-fa9d-4e65-a493-ec82f3bee898 tempest-VolumesAssistedSnapshotsTest-1046434315 None] Lock "cinder-quobyte-8459477c-42c2-4f0c-b93d-b01fe0e2a896" released by "delete_volume" :: held 1.716s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:52:12 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-9f256969-fa9d-4e65-a493-ec82f3bee898 tempest-VolumesAssistedSnapshotsTest-1046434315 None] Created reservations ['6f50ef82-8788-40a5-b96a-9c04edf1e442', '27892a6f-04df-4bf4-ab0e-fbc6b71c70a0', '276b998f-39dc-48f4-b15d-fe949734c86f', '897d96e2-8e62-46d7-a9de-d5b14fddff70'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:52:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9f256969-fa9d-4e65-a493-ec82f3bee898 tempest-VolumesAssistedSnapshotsTest-1046434315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:52:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9f256969-fa9d-4e65-a493-ec82f3bee898 tempest-VolumesAssistedSnapshotsTest-1046434315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:52:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-9f256969-fa9d-4e65-a493-ec82f3bee898 tempest-VolumesAssistedSnapshotsTest-1046434315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:52:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-9f256969-fa9d-4e65-a493-ec82f3bee898 tempest-VolumesAssistedSnapshotsTest-1046434315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:52:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9f256969-fa9d-4e65-a493-ec82f3bee898 tempest-VolumesAssistedSnapshotsTest-1046434315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:52:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f256969-fa9d-4e65-a493-ec82f3bee898 tempest-VolumesAssistedSnapshotsTest-1046434315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:12 devstack sudo[83231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:52:12 devstack sudo[83231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:13 devstack sudo[83231]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f256969-fa9d-4e65-a493-ec82f3bee898 tempest-VolumesAssistedSnapshotsTest-1046434315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.966s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:13 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-9f256969-fa9d-4e65-a493-ec82f3bee898 tempest-VolumesAssistedSnapshotsTest-1046434315 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:52:13 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-9f256969-fa9d-4e65-a493-ec82f3bee898 tempest-VolumesAssistedSnapshotsTest-1046434315 None] Deleted volume successfully.
Nov 19 12:52:13 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9f256969-fa9d-4e65-a493-ec82f3bee898 tempest-VolumesAssistedSnapshotsTest-1046434315 None] Lock "cinder-8459477c-42c2-4f0c-b93d-b01fe0e2a896-delete_volume" released by "delete_volume" :: held 3.054s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:52:22 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=18,cinder:UPDATE=27,cinder:INSERT=2 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:52:23 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=15,cinder:INSERT=6,cinder:UPDATE=8,cinder:DELETE=2 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:52:25 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:52:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Flow 'volume_create_manager' (5e108176-50dd-41e2-963e-90b1ee811fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:52:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (974581ca-35a1-49ca-b614-60d762a15c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (974581ca-35a1-49ca-b614-60d762a15c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1284126901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f25197-d16c-4e7d-a464-ca749115b4e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abbe0fc24a1041298d9e4cee47c5a510',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:52:25Z,use_quota=True,user_id='0f485e68d6de4351a85a6fd1d0ac5d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02379513-85b3-4991-a974-63d9964f9101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02379513-85b3-4991-a974-63d9964f9101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (966a72c2-b716-4bc4-8fdf-7e24964c9d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:25 devstack cinder-volume[80839]: DEBUG cinder.image.glance [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Creating Keystone auth plugin from conf {{(pid=80839) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Nov 19 12:52:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (966a72c2-b716-4bc4-8fdf-7e24964c9d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '66f25197-d16c-4e7d-a464-ca749115b4e4', 'volume_name': 'volume-66f25197-d16c-4e7d-a464-ca749115b4e4', 'volume_size': 1, 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb13a00dd9444268988d63a8279e0575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5d491c17-c417-4a2b-886e-ad2958917626', 'created_at': datetime.datetime(2025, 11, 19, 11, 46, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 19, 11, 46, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d491c17-c417-4a2b-886e-ad2958917626/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbd13fcdf60>}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92593b5f-d93f-4fd2-8590-7042dafaa507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92593b5f-d93f-4fd2-8590-7042dafaa507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b31145bd-f321-4067-97d1-2d7190d2b783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:25 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Volume 66f25197-d16c-4e7d-a464-ca749115b4e4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-66f25197-d16c-4e7d-a464-ca749115b4e4', 'volume_size': 1, 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb13a00dd9444268988d63a8279e0575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5d491c17-c417-4a2b-886e-ad2958917626', 'created_at': datetime.datetime(2025, 11, 19, 11, 46, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 19, 11, 46, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d491c17-c417-4a2b-886e-ad2958917626/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbd13fcdf60>}
Nov 19 12:52:25 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Cloning 66f25197-d16c-4e7d-a464-ca749115b4e4 from image 5d491c17-c417-4a2b-886e-ad2958917626  at location (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]). {{(pid=80839) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Nov 19 12:52:25 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_uoscj8cndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=80839) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Nov 19 12:52:25 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Image download 20.69 MB at 20.69 MB/s
Nov 19 12:52:25 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c198a0d8-47cc-4cdd-9a39-12bae3fa241f]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:52:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_uoscj8cndevstack@QuobyteHD {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:25 devstack sudo[83327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_uoscj8cndevstack@QuobyteHD
Nov 19 12:52:25 devstack sudo[83327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:26 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:52:26 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Flow 'volume_create_manager' (48739822-89e5-4cef-89ee-84df33d1a1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:52:26 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2165ffa-ff7a-4fb6-8d58-750c368ac425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:26 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2165ffa-ff7a-4fb6-8d58-750c368ac425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-867622751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=298f49e0-9284-49f6-8459-964e0189004f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f96ca31d26cc40e8a5a92d7ae86d0072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:52:26Z,use_quota=True,user_id='5de02b46602a42478520ef0f4185147f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:26 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfcbab83-7c6d-4f6e-b627-07cf7c073d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:26 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfcbab83-7c6d-4f6e-b627-07cf7c073d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:26 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4310882-de57-435b-9188-add0dff881ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:26 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4310882-de57-435b-9188-add0dff881ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '298f49e0-9284-49f6-8459-964e0189004f', 'volume_name': 'volume-298f49e0-9284-49f6-8459-964e0189004f', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:26 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c44c1e2-54c7-468d-811c-c3b0195228f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:26 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c44c1e2-54c7-468d-811c-c3b0195228f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:26 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170dde44-2974-4009-b12e-db5064139fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:26 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Volume 298f49e0-9284-49f6-8459-964e0189004f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-298f49e0-9284-49f6-8459-964e0189004f', 'volume_size': 1}
Nov 19 12:52:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:52:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:52:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-867622751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=298f49e0-9284-49f6-8459-964e0189004f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f96ca31d26cc40e8a5a92d7ae86d0072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:52:26Z,use_quota=True,user_id='5de02b46602a42478520ef0f4185147f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:52:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Creating volume 298f49e0-9284-49f6-8459-964e0189004f {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:52:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:52:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:52:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:52:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:52:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:52:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:52:26 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:52:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-298f49e0-9284-49f6-8459-964e0189004f 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:26 devstack sudo[83330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-298f49e0-9284-49f6-8459-964e0189004f 1073741824
Nov 19 12:52:26 devstack sudo[83330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:26 devstack sudo[83327]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_uoscj8cndevstack@QuobyteHD" returned: 0 in 1.063s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:26 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Temporary image 5d491c17-c417-4a2b-886e-ad2958917626 is fetched for user 0f485e68d6de4351a85a6fd1d0ac5d87. {{(pid=80839) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Nov 19 12:52:26 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[177a2981-c043-4441-8037-6efc043a583c]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:52:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_uoscj8cndevstack@QuobyteHD {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:27 devstack sudo[83335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_uoscj8cndevstack@QuobyteHD
Nov 19 12:52:27 devstack sudo[83335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:27 devstack sudo[83330]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-298f49e0-9284-49f6-8459-964e0189004f 1073741824" returned: 0 in 1.415s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-298f49e0-9284-49f6-8459-964e0189004f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:27 devstack sudo[83340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-298f49e0-9284-49f6-8459-964e0189004f
Nov 19 12:52:27 devstack sudo[83340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:28 devstack sudo[83335]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_uoscj8cndevstack@QuobyteHD" returned: 0 in 1.397s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:52:28 devstack sudo[83340]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-298f49e0-9284-49f6-8459-964e0189004f" returned: 0 in 0.727s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] <== create_volume: return (2149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:52:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.151s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:52:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.255s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:52:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1284126901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f25197-d16c-4e7d-a464-ca749115b4e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abbe0fc24a1041298d9e4cee47c5a510',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:52:25Z,use_quota=True,user_id='0f485e68d6de4351a85a6fd1d0ac5d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:52:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Creating volume 66f25197-d16c-4e7d-a464-ca749115b4e4 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:52:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:52:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:52:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:52:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:52:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:52:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:52:28 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:52:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170dde44-2974-4009-b12e-db5064139fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-298f49e0-9284-49f6-8459-964e0189004f', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a952e9b6-461f-4a32-aa20-14c0c3c330e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:28 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Volume volume-298f49e0-9284-49f6-8459-964e0189004f (298f49e0-9284-49f6-8459-964e0189004f): created successfully
Nov 19 12:52:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a952e9b6-461f-4a32-aa20-14c0c3c330e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:28 devstack sudo[83384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4 1073741824
Nov 19 12:52:28 devstack sudo[83384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Flow 'volume_create_manager' (48739822-89e5-4cef-89ee-84df33d1a1a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:52:28 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-68193652-d260-490b-9022-dc3529ac9a84 tempest-ServersNegativeTestJSON-324140569 None] Created volume successfully.
Nov 19 12:52:29 devstack sudo[83384]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4 1073741824" returned: 0 in 0.948s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:29 devstack sudo[83392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4
Nov 19 12:52:29 devstack sudo[83392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:30 devstack sudo[83392]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4" returned: 0 in 0.608s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG cinder.volume.volume_utils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Attempting download of 5d491c17-c417-4a2b-886e-ad2958917626 ((None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}])) to volume 66f25197-d16c-4e7d-a464-ca749115b4e4. {{(pid=80839) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d61a75-e149-4c30-9e20-8d9758b52fb4]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_ash3h2_f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:30 devstack sudo[83396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_ash3h2_f
Nov 19 12:52:30 devstack sudo[83396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Flow 'volume_create_manager' (aa5fa38b-cb31-4764-8be4-d4f518a5d32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3322001d-9bce-4b5b-a696-ae933fcf9cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3322001d-9bce-4b5b-a696-ae933fcf9cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2071328904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392dff64-dcb9-4601-8b12-a9dfe779e0af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f96ca31d26cc40e8a5a92d7ae86d0072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:52:31Z,use_quota=True,user_id='5de02b46602a42478520ef0f4185147f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ccdf41-72c6-4eab-b438-1e0dd367f6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ccdf41-72c6-4eab-b438-1e0dd367f6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6279c47-6235-4709-94f8-5cadb65c04b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6279c47-6235-4709-94f8-5cadb65c04b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '392dff64-dcb9-4601-8b12-a9dfe779e0af', 'volume_name': 'volume-392dff64-dcb9-4601-8b12-a9dfe779e0af', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eda2238-54c6-48e4-ae2f-4067677c14c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eda2238-54c6-48e4-ae2f-4067677c14c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee3a822-785f-4f25-b3b7-bac5e2e00d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:30 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Volume 392dff64-dcb9-4601-8b12-a9dfe779e0af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-392dff64-dcb9-4601-8b12-a9dfe779e0af', 'volume_size': 1}
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2071328904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392dff64-dcb9-4601-8b12-a9dfe779e0af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f96ca31d26cc40e8a5a92d7ae86d0072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:52:31Z,use_quota=True,user_id='5de02b46602a42478520ef0f4185147f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Creating volume 392dff64-dcb9-4601-8b12-a9dfe779e0af {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:52:30 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:52:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-392dff64-dcb9-4601-8b12-a9dfe779e0af 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:30 devstack sudo[83399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-392dff64-dcb9-4601-8b12-a9dfe779e0af 1073741824
Nov 19 12:52:30 devstack sudo[83399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:31 devstack sudo[83396]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_ash3h2_f" returned: 0 in 1.096s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_ash3h2_f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:31 devstack sudo[83403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_ash3h2_f
Nov 19 12:52:31 devstack sudo[83403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:31 devstack sudo[83403]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_ash3h2_f" returned: 1 in 0.787s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_ash3h2_f' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 12:52:31 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3101fc7-01ed-4054-a3fd-230043adfb24]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:52:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_uoscj8cndevstack@QuobyteHD {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:32 devstack sudo[83399]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-392dff64-dcb9-4601-8b12-a9dfe779e0af 1073741824" returned: 0 in 1.186s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-392dff64-dcb9-4601-8b12-a9dfe779e0af {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:32 devstack sudo[83411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-392dff64-dcb9-4601-8b12-a9dfe779e0af
Nov 19 12:52:32 devstack sudo[83411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:32 devstack sudo[83410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_uoscj8cndevstack@QuobyteHD
Nov 19 12:52:32 devstack sudo[83410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:32 devstack sudo[83411]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-392dff64-dcb9-4601-8b12-a9dfe779e0af" returned: 0 in 0.606s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:32 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:52:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:52:32 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee3a822-785f-4f25-b3b7-bac5e2e00d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-392dff64-dcb9-4601-8b12-a9dfe779e0af', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:32 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083584df-9390-4b31-9350-c1b7fd8c0a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:32 devstack sudo[83410]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_uoscj8cndevstack@QuobyteHD" returned: 0 in 0.651s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:32 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] 5d491c17-c417-4a2b-886e-ad2958917626 was qcow2, converting to raw {{(pid=80839) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Nov 19 12:52:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_uoscj8cndevstack@QuobyteHD /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:32 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Volume volume-392dff64-dcb9-4601-8b12-a9dfe779e0af (392dff64-dcb9-4601-8b12-a9dfe779e0af): created successfully
Nov 19 12:52:32 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083584df-9390-4b31-9350-c1b7fd8c0a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:32 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Flow 'volume_create_manager' (aa5fa38b-cb31-4764-8be4-d4f518a5d32f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:52:32 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-cb61eb5f-fc6e-4254-82d6-70d0789a0d69 tempest-ServersNegativeTestJSON-324140569 None] Created volume successfully.
Nov 19 12:52:32 devstack sudo[83419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_uoscj8cndevstack@QuobyteHD /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4
Nov 19 12:52:32 devstack sudo[83419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-fd876b49-767f-4336-86f1-2535896b7b99 tempest-ServersNegativeTestJSON-324140569 None] Acquiring lock "cinder-392dff64-dcb9-4601-8b12-a9dfe779e0af-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:52:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-fd876b49-767f-4336-86f1-2535896b7b99 tempest-ServersNegativeTestJSON-324140569 None] Lock "cinder-392dff64-dcb9-4601-8b12-a9dfe779e0af-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:52:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-fd876b49-767f-4336-86f1-2535896b7b99 tempest-ServersNegativeTestJSON-324140569 None] Acquiring lock "cinder-quobyte-392dff64-dcb9-4601-8b12-a9dfe779e0af" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:52:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-fd876b49-767f-4336-86f1-2535896b7b99 tempest-ServersNegativeTestJSON-324140569 None] Lock "cinder-quobyte-392dff64-dcb9-4601-8b12-a9dfe779e0af" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:52:33 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b116f8f-62a3-463c-bac0-866a0e740c5d]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:52:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fd876b49-767f-4336-86f1-2535896b7b99 tempest-ServersNegativeTestJSON-324140569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-392dff64-dcb9-4601-8b12-a9dfe779e0af {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:33 devstack sudo[83422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-392dff64-dcb9-4601-8b12-a9dfe779e0af
Nov 19 12:52:33 devstack sudo[83422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:33 devstack sudo[83422]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fd876b49-767f-4336-86f1-2535896b7b99 tempest-ServersNegativeTestJSON-324140569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-392dff64-dcb9-4601-8b12-a9dfe779e0af" returned: 0 in 0.657s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fd876b49-767f-4336-86f1-2535896b7b99 tempest-ServersNegativeTestJSON-324140569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-392dff64-dcb9-4601-8b12-a9dfe779e0af {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:33 devstack sudo[83419]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:33 devstack sudo[83432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-392dff64-dcb9-4601-8b12-a9dfe779e0af
Nov 19 12:52:33 devstack sudo[83432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_uoscj8cndevstack@QuobyteHD /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4" returned: 0 in 1.187s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:33 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_uoscj8cndevstack@QuobyteHD, size 112.00 MB, duration 1.19 sec, destination /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4 {{(pid=80839) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 19 12:52:33 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Converted 112.00 MB image at 94.27 MB/s
Nov 19 12:52:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:33 devstack sudo[83434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4 1G
Nov 19 12:52:33 devstack sudo[83434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:34 devstack sudo[83432]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fd876b49-767f-4336-86f1-2535896b7b99 tempest-ServersNegativeTestJSON-324140569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-392dff64-dcb9-4601-8b12-a9dfe779e0af" returned: 0 in 0.519s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:34 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-fd876b49-767f-4336-86f1-2535896b7b99 tempest-ServersNegativeTestJSON-324140569 None] Lock "cinder-quobyte-392dff64-dcb9-4601-8b12-a9dfe779e0af" released by "delete_volume" :: held 1.222s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:52:34 devstack sudo[83434]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4 1G" returned: 0 in 0.537s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:34 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-fd876b49-767f-4336-86f1-2535896b7b99 tempest-ServersNegativeTestJSON-324140569 None] Created reservations ['5fb8fdf2-26a0-4d35-860f-1d4de6e570d0', 'd8684a2a-fac1-4a8d-bbbf-3e3f821accb6', 'aa8e5797-a147-452d-90eb-0fd120917746', '2f5c0d50-df10-4366-85e8-5aa1b43ac0ab'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:52:34 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[657f2a90-3063-4d25-95c5-e60013dad7b4]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:52:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-fd876b49-767f-4336-86f1-2535896b7b99 tempest-ServersNegativeTestJSON-324140569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:52:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-fd876b49-767f-4336-86f1-2535896b7b99 tempest-ServersNegativeTestJSON-324140569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:52:34 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-fd876b49-767f-4336-86f1-2535896b7b99 tempest-ServersNegativeTestJSON-324140569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:52:34 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-fd876b49-767f-4336-86f1-2535896b7b99 tempest-ServersNegativeTestJSON-324140569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:52:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-fd876b49-767f-4336-86f1-2535896b7b99 tempest-ServersNegativeTestJSON-324140569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:52:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fd876b49-767f-4336-86f1-2535896b7b99 tempest-ServersNegativeTestJSON-324140569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:34 devstack sudo[83442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:52:34 devstack sudo[83442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:34 devstack sudo[83441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4
Nov 19 12:52:34 devstack sudo[83441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:35 devstack sudo[83442]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fd876b49-767f-4336-86f1-2535896b7b99 tempest-ServersNegativeTestJSON-324140569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.547s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:35 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-fd876b49-767f-4336-86f1-2535896b7b99 tempest-ServersNegativeTestJSON-324140569 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:52:35 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-fd876b49-767f-4336-86f1-2535896b7b99 tempest-ServersNegativeTestJSON-324140569 None] Deleted volume successfully.
Nov 19 12:52:35 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-fd876b49-767f-4336-86f1-2535896b7b99 tempest-ServersNegativeTestJSON-324140569 None] Lock "cinder-392dff64-dcb9-4601-8b12-a9dfe779e0af-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:52:35 devstack sudo[83441]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4" returned: 0 in 0.687s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:35 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-70407268-3bee-4d97-a2f1-17b2806bf68b tempest-ServersNegativeTestJSON-324140569 None] Acquiring lock "cinder-298f49e0-9284-49f6-8459-964e0189004f-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:52:35 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-70407268-3bee-4d97-a2f1-17b2806bf68b tempest-ServersNegativeTestJSON-324140569 None] Lock "cinder-298f49e0-9284-49f6-8459-964e0189004f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:52:35 devstack sudo[83454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4
Nov 19 12:52:35 devstack sudo[83454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:35 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-70407268-3bee-4d97-a2f1-17b2806bf68b tempest-ServersNegativeTestJSON-324140569 None] Acquiring lock "cinder-quobyte-298f49e0-9284-49f6-8459-964e0189004f" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:52:35 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-70407268-3bee-4d97-a2f1-17b2806bf68b tempest-ServersNegativeTestJSON-324140569 None] Lock "cinder-quobyte-298f49e0-9284-49f6-8459-964e0189004f" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:52:35 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59489a7-24d9-4fde-b32e-f6277f6a2674]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:52:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-70407268-3bee-4d97-a2f1-17b2806bf68b tempest-ServersNegativeTestJSON-324140569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-298f49e0-9284-49f6-8459-964e0189004f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:35 devstack sudo[83456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-298f49e0-9284-49f6-8459-964e0189004f
Nov 19 12:52:35 devstack sudo[83456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:35 devstack sudo[83454]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4" returned: 1 in 0.770s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 12:52:35 devstack cinder-volume[80839]: DEBUG cinder.volume.volume_utils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Downloaded image 5d491c17-c417-4a2b-886e-ad2958917626 ((None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}])) to volume 66f25197-d16c-4e7d-a464-ca749115b4e4 successfully. {{(pid=80839) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Nov 19 12:52:35 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Temporary image 5d491c17-c417-4a2b-886e-ad2958917626 for user 0f485e68d6de4351a85a6fd1d0ac5d87 is deleted. {{(pid=80839) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Nov 19 12:52:35 devstack cinder-volume[80839]: DEBUG cinder.volume.volume_utils [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Marking volume 66f25197-d16c-4e7d-a464-ca749115b4e4 as bootable. {{(pid=80839) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Nov 19 12:52:35 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Copying metadata from image 5d491c17-c417-4a2b-886e-ad2958917626 to 66f25197-d16c-4e7d-a464-ca749115b4e4. {{(pid=80839) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 19 12:52:35 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Creating volume glance metadata for volume 66f25197-d16c-4e7d-a464-ca749115b4e4 backed by image 5d491c17-c417-4a2b-886e-ad2958917626 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=80839) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 19 12:52:36 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b31145bd-f321-4067-97d1-2d7190d2b783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66f25197-d16c-4e7d-a464-ca749115b4e4', 'volume_size': 1, 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb13a00dd9444268988d63a8279e0575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5d491c17-c417-4a2b-886e-ad2958917626', 'created_at': datetime.datetime(2025, 11, 19, 11, 46, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 19, 11, 46, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d491c17-c417-4a2b-886e-ad2958917626/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbd13fcdf60>}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:36 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d589ce00-5860-4aae-9ed6-6628faa694dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:36 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Volume volume-66f25197-d16c-4e7d-a464-ca749115b4e4 (66f25197-d16c-4e7d-a464-ca749115b4e4): created successfully
Nov 19 12:52:36 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d589ce00-5860-4aae-9ed6-6628faa694dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:36 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Flow 'volume_create_manager' (5e108176-50dd-41e2-963e-90b1ee811fc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:52:36 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-80fb27fe-6f13-4110-9436-3bb10d3177f0 tempest-TaggedBootDevicesTest_v242-995872979 None] Created volume successfully.
Nov 19 12:52:36 devstack sudo[83456]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-70407268-3bee-4d97-a2f1-17b2806bf68b tempest-ServersNegativeTestJSON-324140569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-298f49e0-9284-49f6-8459-964e0189004f" returned: 0 in 0.654s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-70407268-3bee-4d97-a2f1-17b2806bf68b tempest-ServersNegativeTestJSON-324140569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-298f49e0-9284-49f6-8459-964e0189004f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:36 devstack sudo[83465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-298f49e0-9284-49f6-8459-964e0189004f
Nov 19 12:52:36 devstack sudo[83465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:36 devstack sudo[83465]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-70407268-3bee-4d97-a2f1-17b2806bf68b tempest-ServersNegativeTestJSON-324140569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-298f49e0-9284-49f6-8459-964e0189004f" returned: 0 in 0.481s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:36 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-70407268-3bee-4d97-a2f1-17b2806bf68b tempest-ServersNegativeTestJSON-324140569 None] Lock "cinder-quobyte-298f49e0-9284-49f6-8459-964e0189004f" released by "delete_volume" :: held 1.163s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:52:36 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-70407268-3bee-4d97-a2f1-17b2806bf68b tempest-ServersNegativeTestJSON-324140569 None] Created reservations ['b9b6d360-5a96-4e91-a74e-46cf30b29201', 'dcf2770d-8c32-4fcd-bee7-a201ed070108', 'd4ab2a2f-1ba0-420a-bc36-3cbb76c122a4', '64d1b06a-1f5e-431a-ae57-241af38ffca4'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:52:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-70407268-3bee-4d97-a2f1-17b2806bf68b tempest-ServersNegativeTestJSON-324140569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:52:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-70407268-3bee-4d97-a2f1-17b2806bf68b tempest-ServersNegativeTestJSON-324140569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:52:36 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-70407268-3bee-4d97-a2f1-17b2806bf68b tempest-ServersNegativeTestJSON-324140569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:52:36 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-70407268-3bee-4d97-a2f1-17b2806bf68b tempest-ServersNegativeTestJSON-324140569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:52:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-70407268-3bee-4d97-a2f1-17b2806bf68b tempest-ServersNegativeTestJSON-324140569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:52:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-70407268-3bee-4d97-a2f1-17b2806bf68b tempest-ServersNegativeTestJSON-324140569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:36 devstack sudo[83468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:52:36 devstack sudo[83468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:37 devstack sudo[83468]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-70407268-3bee-4d97-a2f1-17b2806bf68b tempest-ServersNegativeTestJSON-324140569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.496s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:37 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-70407268-3bee-4d97-a2f1-17b2806bf68b tempest-ServersNegativeTestJSON-324140569 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:52:37 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-70407268-3bee-4d97-a2f1-17b2806bf68b tempest-ServersNegativeTestJSON-324140569 None] Deleted volume successfully.
Nov 19 12:52:37 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-70407268-3bee-4d97-a2f1-17b2806bf68b tempest-ServersNegativeTestJSON-324140569 None] Lock "cinder-298f49e0-9284-49f6-8459-964e0189004f-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:52:37 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:52:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Flow 'volume_create_manager' (2e20bad8-bdd1-4274-9a8d-85436df5de06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:52:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2d1117-d688-4653-b2cb-391185325bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2d1117-d688-4653-b2cb-391185325bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-913717164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=445bd5af-207c-4c72-9eb8-d1189278de39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abbe0fc24a1041298d9e4cee47c5a510',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:52:37Z,use_quota=True,user_id='0f485e68d6de4351a85a6fd1d0ac5d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c424886e-f420-4434-b0d2-e192af370994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c424886e-f420-4434-b0d2-e192af370994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7bbd1c5-1ce0-42d1-8d8d-9f142e169ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7bbd1c5-1ce0-42d1-8d8d-9f142e169ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '445bd5af-207c-4c72-9eb8-d1189278de39', 'volume_name': 'volume-445bd5af-207c-4c72-9eb8-d1189278de39', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25c206e-638c-407d-9bb9-b016f6673edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25c206e-638c-407d-9bb9-b016f6673edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05de1496-b450-4f48-bf19-f4d8278109f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:37 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Volume 445bd5af-207c-4c72-9eb8-d1189278de39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-445bd5af-207c-4c72-9eb8-d1189278de39', 'volume_size': 1}
Nov 19 12:52:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:52:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:52:37 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-913717164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=445bd5af-207c-4c72-9eb8-d1189278de39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abbe0fc24a1041298d9e4cee47c5a510',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:52:37Z,use_quota=True,user_id='0f485e68d6de4351a85a6fd1d0ac5d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:52:37 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Creating volume 445bd5af-207c-4c72-9eb8-d1189278de39 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:52:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:52:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:52:37 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:52:37 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:52:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:52:37 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:52:37 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:52:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-445bd5af-207c-4c72-9eb8-d1189278de39 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:37 devstack sudo[83471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-445bd5af-207c-4c72-9eb8-d1189278de39 1073741824
Nov 19 12:52:37 devstack sudo[83471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:38 devstack sudo[83471]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-445bd5af-207c-4c72-9eb8-d1189278de39 1073741824" returned: 0 in 0.704s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-445bd5af-207c-4c72-9eb8-d1189278de39 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:38 devstack sudo[83477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-445bd5af-207c-4c72-9eb8-d1189278de39
Nov 19 12:52:38 devstack sudo[83477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:38 devstack sudo[83477]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-445bd5af-207c-4c72-9eb8-d1189278de39" returned: 0 in 0.734s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05de1496-b450-4f48-bf19-f4d8278109f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-445bd5af-207c-4c72-9eb8-d1189278de39', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a2495ae-a931-4248-9551-8df810ca69bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:39 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Volume volume-445bd5af-207c-4c72-9eb8-d1189278de39 (445bd5af-207c-4c72-9eb8-d1189278de39): created successfully
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a2495ae-a931-4248-9551-8df810ca69bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Flow 'volume_create_manager' (2e20bad8-bdd1-4274-9a8d-85436df5de06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:52:39 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-4b7d097c-d3c7-44c9-b80b-eb7ec68e6584 tempest-TaggedBootDevicesTest_v242-995872979 None] Created volume successfully.
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Flow 'volume_create_manager' (d0b0ac64-9c34-40c6-9946-9a92a6808ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2521d4f-ffb5-42ab-9293-204f37bf0f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2521d4f-ffb5-42ab-9293-204f37bf0f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-419933903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce87d79-18f5-43dc-acb2-639edfb8dacc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abbe0fc24a1041298d9e4cee47c5a510',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:52:40Z,use_quota=True,user_id='0f485e68d6de4351a85a6fd1d0ac5d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859bbee3-0854-4490-b185-db6e209ac235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859bbee3-0854-4490-b185-db6e209ac235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b174afbc-98e5-4fb7-a206-097a5d1ddf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b174afbc-98e5-4fb7-a206-097a5d1ddf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ce87d79-18f5-43dc-acb2-639edfb8dacc', 'volume_name': 'volume-4ce87d79-18f5-43dc-acb2-639edfb8dacc', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd6bd7f2-325a-4005-9c68-f6132edf68ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd6bd7f2-325a-4005-9c68-f6132edf68ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f867c7c-8751-4f2f-a95c-3b64db95187d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:39 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Volume 4ce87d79-18f5-43dc-acb2-639edfb8dacc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ce87d79-18f5-43dc-acb2-639edfb8dacc', 'volume_size': 1}
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-419933903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce87d79-18f5-43dc-acb2-639edfb8dacc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abbe0fc24a1041298d9e4cee47c5a510',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:52:40Z,use_quota=True,user_id='0f485e68d6de4351a85a6fd1d0ac5d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Creating volume 4ce87d79-18f5-43dc-acb2-639edfb8dacc {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:52:39 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:52:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4ce87d79-18f5-43dc-acb2-639edfb8dacc 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:39 devstack sudo[83511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4ce87d79-18f5-43dc-acb2-639edfb8dacc 1073741824
Nov 19 12:52:39 devstack sudo[83511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:40 devstack sudo[83511]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4ce87d79-18f5-43dc-acb2-639edfb8dacc 1073741824" returned: 0 in 0.809s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4ce87d79-18f5-43dc-acb2-639edfb8dacc {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:40 devstack sudo[83517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4ce87d79-18f5-43dc-acb2-639edfb8dacc
Nov 19 12:52:40 devstack sudo[83517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:41 devstack sudo[83517]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4ce87d79-18f5-43dc-acb2-639edfb8dacc" returned: 0 in 0.599s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:41 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:52:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:52:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f867c7c-8751-4f2f-a95c-3b64db95187d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ce87d79-18f5-43dc-acb2-639edfb8dacc', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82028156-1734-48ab-9049-04492b0ac1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:41 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Volume volume-4ce87d79-18f5-43dc-acb2-639edfb8dacc (4ce87d79-18f5-43dc-acb2-639edfb8dacc): created successfully
Nov 19 12:52:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82028156-1734-48ab-9049-04492b0ac1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Flow 'volume_create_manager' (d0b0ac64-9c34-40c6-9946-9a92a6808ce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:52:41 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-e296c00f-25eb-43f6-8016-dfae62f45dcf tempest-TaggedBootDevicesTest_v242-995872979 None] Created volume successfully.
Nov 19 12:52:51 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=25,cinder:UPDATE=29,cinder:INSERT=11,cinder:DELETE=4 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:52:51 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=20,cinder:UPDATE=26,cinder:INSERT=10,cinder:DELETE=3 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:52:52 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:52:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Flow 'volume_create_manager' (53eac18d-e351-47a6-9246-ccd0cf8cbe3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:52:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6402584e-56dc-448a-95ed-83bea44319e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6402584e-56dc-448a-95ed-83bea44319e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-495602968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da1f25bd-9da7-4838-8405-2f8556699b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='267d213052064c5fb6ba61e1eeecfe25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:52:52Z,use_quota=True,user_id='b84218054e5c4708bf80f613158459f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c1a2a47-9732-4328-b22e-693f35cedd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c1a2a47-9732-4328-b22e-693f35cedd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d21bf82-d283-40f5-90b5-f1fa5f6ea22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d21bf82-d283-40f5-90b5-f1fa5f6ea22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da1f25bd-9da7-4838-8405-2f8556699b07', 'volume_name': 'volume-da1f25bd-9da7-4838-8405-2f8556699b07', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a395d80-add3-47e2-b0a2-96a49946a149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a395d80-add3-47e2-b0a2-96a49946a149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc75c4b4-755e-4f48-8a15-969e2a4daf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:52 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Volume da1f25bd-9da7-4838-8405-2f8556699b07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da1f25bd-9da7-4838-8405-2f8556699b07', 'volume_size': 1}
Nov 19 12:52:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:52:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:52:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-495602968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da1f25bd-9da7-4838-8405-2f8556699b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='267d213052064c5fb6ba61e1eeecfe25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:52:52Z,use_quota=True,user_id='b84218054e5c4708bf80f613158459f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:52:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Creating volume da1f25bd-9da7-4838-8405-2f8556699b07 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:52:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:52:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:52:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:52:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:52:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:52:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:52:52 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:52:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:52 devstack sudo[83544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07 1073741824
Nov 19 12:52:52 devstack sudo[83544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:52 devstack sudo[83544]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07 1073741824" returned: 0 in 0.643s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:52 devstack sudo[83554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07
Nov 19 12:52:52 devstack sudo[83554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:53 devstack sudo[83554]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07" returned: 0 in 0.595s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:53 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:52:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:52:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc75c4b4-755e-4f48-8a15-969e2a4daf75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da1f25bd-9da7-4838-8405-2f8556699b07', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53614304-9ffe-4b8e-b790-b75f4f56e86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:52:53 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Volume volume-da1f25bd-9da7-4838-8405-2f8556699b07 (da1f25bd-9da7-4838-8405-2f8556699b07): created successfully
Nov 19 12:52:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53614304-9ffe-4b8e-b790-b75f4f56e86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:52:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Flow 'volume_create_manager' (53eac18d-e351-47a6-9246-ccd0cf8cbe3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:52:53 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-72d52107-651b-4aba-9d55-315354279748 req-d00f18df-1f2c-4580-9975-82bac5d2dfa2 tempest-VolumesSnapshotsTestJSON-111050048 None] Created volume successfully.
Nov 19 12:52:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-701782f6-6c52-485b-a0c1-44dc74e9aa4f req-b16276c8-0b96-43cc-8133-71a2201e510a tempest-VolumesSnapshotsTestJSON-111050048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:52:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-701782f6-6c52-485b-a0c1-44dc74e9aa4f req-b16276c8-0b96-43cc-8133-71a2201e510a tempest-VolumesSnapshotsTestJSON-111050048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:52:55 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [req-701782f6-6c52-485b-a0c1-44dc74e9aa4f req-b16276c8-0b96-43cc-8133-71a2201e510a tempest-VolumesSnapshotsTestJSON-111050048 None] Creating offline snapshot 69ec3e81-8923-4a52-a9b0-6d9dc74d3577 of volume da1f25bd-9da7-4838-8405-2f8556699b07 {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 12:52:55 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f55e3f-1956-4f2c-8d15-f8b689843fb2]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:52:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-701782f6-6c52-485b-a0c1-44dc74e9aa4f req-b16276c8-0b96-43cc-8133-71a2201e510a tempest-VolumesSnapshotsTestJSON-111050048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:55 devstack sudo[83898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07
Nov 19 12:52:55 devstack sudo[83898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:55 devstack sudo[83898]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-701782f6-6c52-485b-a0c1-44dc74e9aa4f req-b16276c8-0b96-43cc-8133-71a2201e510a tempest-VolumesSnapshotsTestJSON-111050048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07" returned: 0 in 0.809s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-701782f6-6c52-485b-a0c1-44dc74e9aa4f req-b16276c8-0b96-43cc-8133-71a2201e510a tempest-VolumesSnapshotsTestJSON-111050048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07.69ec3e81-8923-4a52-a9b0-6d9dc74d3577 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:55 devstack sudo[83997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07.69ec3e81-8923-4a52-a9b0-6d9dc74d3577 1G
Nov 19 12:52:55 devstack sudo[83997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:56 devstack sudo[83997]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-701782f6-6c52-485b-a0c1-44dc74e9aa4f req-b16276c8-0b96-43cc-8133-71a2201e510a tempest-VolumesSnapshotsTestJSON-111050048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07.69ec3e81-8923-4a52-a9b0-6d9dc74d3577 1G" returned: 0 in 0.944s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-701782f6-6c52-485b-a0c1-44dc74e9aa4f req-b16276c8-0b96-43cc-8133-71a2201e510a tempest-VolumesSnapshotsTestJSON-111050048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da1f25bd-9da7-4838-8405-2f8556699b07 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07.69ec3e81-8923-4a52-a9b0-6d9dc74d3577 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:56 devstack sudo[84017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da1f25bd-9da7-4838-8405-2f8556699b07 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07.69ec3e81-8923-4a52-a9b0-6d9dc74d3577
Nov 19 12:52:56 devstack sudo[84017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:57 devstack sudo[84017]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-701782f6-6c52-485b-a0c1-44dc74e9aa4f req-b16276c8-0b96-43cc-8133-71a2201e510a tempest-VolumesSnapshotsTestJSON-111050048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da1f25bd-9da7-4838-8405-2f8556699b07 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07.69ec3e81-8923-4a52-a9b0-6d9dc74d3577" returned: 0 in 0.656s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:57 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [req-701782f6-6c52-485b-a0c1-44dc74e9aa4f req-b16276c8-0b96-43cc-8133-71a2201e510a tempest-VolumesSnapshotsTestJSON-111050048 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07.69ec3e81-8923-4a52-a9b0-6d9dc74d3577 is being set with open permissions: ugo+rw
Nov 19 12:52:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-701782f6-6c52-485b-a0c1-44dc74e9aa4f req-b16276c8-0b96-43cc-8133-71a2201e510a tempest-VolumesSnapshotsTestJSON-111050048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07.69ec3e81-8923-4a52-a9b0-6d9dc74d3577 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:57 devstack sudo[84025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07.69ec3e81-8923-4a52-a9b0-6d9dc74d3577
Nov 19 12:52:57 devstack sudo[84025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:58 devstack sudo[84025]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-701782f6-6c52-485b-a0c1-44dc74e9aa4f req-b16276c8-0b96-43cc-8133-71a2201e510a tempest-VolumesSnapshotsTestJSON-111050048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07.69ec3e81-8923-4a52-a9b0-6d9dc74d3577" returned: 0 in 0.568s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-701782f6-6c52-485b-a0c1-44dc74e9aa4f req-b16276c8-0b96-43cc-8133-71a2201e510a tempest-VolumesSnapshotsTestJSON-111050048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:58 devstack sudo[84030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07.info
Nov 19 12:52:58 devstack sudo[84030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:58 devstack sudo[84030]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-701782f6-6c52-485b-a0c1-44dc74e9aa4f req-b16276c8-0b96-43cc-8133-71a2201e510a tempest-VolumesSnapshotsTestJSON-111050048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07.info" returned: 0 in 0.566s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:58 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [req-701782f6-6c52-485b-a0c1-44dc74e9aa4f req-b16276c8-0b96-43cc-8133-71a2201e510a tempest-VolumesSnapshotsTestJSON-111050048 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07.info is being set with open permissions: ugo+rw
Nov 19 12:52:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-701782f6-6c52-485b-a0c1-44dc74e9aa4f req-b16276c8-0b96-43cc-8133-71a2201e510a tempest-VolumesSnapshotsTestJSON-111050048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:58 devstack sudo[84034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07.info
Nov 19 12:52:58 devstack sudo[84034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:52:59 devstack sudo[84034]: pam_unix(sudo:session): session closed for user root
Nov 19 12:52:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-701782f6-6c52-485b-a0c1-44dc74e9aa4f req-b16276c8-0b96-43cc-8133-71a2201e510a tempest-VolumesSnapshotsTestJSON-111050048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07.info" returned: 0 in 0.582s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:52:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-701782f6-6c52-485b-a0c1-44dc74e9aa4f req-b16276c8-0b96-43cc-8133-71a2201e510a tempest-VolumesSnapshotsTestJSON-111050048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.179s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:52:59 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-701782f6-6c52-485b-a0c1-44dc74e9aa4f req-b16276c8-0b96-43cc-8133-71a2201e510a tempest-VolumesSnapshotsTestJSON-111050048 None] Create snapshot completed successfully
Nov 19 12:52:59 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-b3a9cb52-3353-449e-8a1b-c3f402d8bc1c req-8442a5da-ef22-4a3c-bc33-2a392a5d2e30 tempest-VolumesSnapshotsTestJSON-111050048 None] Acquiring lock "cinder-69ec3e81-8923-4a52-a9b0-6d9dc74d3577-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:52:59 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-b3a9cb52-3353-449e-8a1b-c3f402d8bc1c req-8442a5da-ef22-4a3c-bc33-2a392a5d2e30 tempest-VolumesSnapshotsTestJSON-111050048 None] Lock "cinder-69ec3e81-8923-4a52-a9b0-6d9dc74d3577-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:52:59 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-b3a9cb52-3353-449e-8a1b-c3f402d8bc1c req-8442a5da-ef22-4a3c-bc33-2a392a5d2e30 tempest-VolumesSnapshotsTestJSON-111050048 None] Acquiring lock "cinder-quobyte-da1f25bd-9da7-4838-8405-2f8556699b07" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:52:59 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-b3a9cb52-3353-449e-8a1b-c3f402d8bc1c req-8442a5da-ef22-4a3c-bc33-2a392a5d2e30 tempest-VolumesSnapshotsTestJSON-111050048 None] Lock "cinder-quobyte-da1f25bd-9da7-4838-8405-2f8556699b07" acquired by "delete_snapshot" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:52:59 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-b3a9cb52-3353-449e-8a1b-c3f402d8bc1c req-8442a5da-ef22-4a3c-bc33-2a392a5d2e30 tempest-VolumesSnapshotsTestJSON-111050048 None] Acquiring lock "cinder-quobyte-69ec3e81-8923-4a52-a9b0-6d9dc74d3577" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:52:59 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-b3a9cb52-3353-449e-8a1b-c3f402d8bc1c req-8442a5da-ef22-4a3c-bc33-2a392a5d2e30 tempest-VolumesSnapshotsTestJSON-111050048 None] Lock "cinder-quobyte-69ec3e81-8923-4a52-a9b0-6d9dc74d3577" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:52:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [req-b3a9cb52-3353-449e-8a1b-c3f402d8bc1c req-8442a5da-ef22-4a3c-bc33-2a392a5d2e30 tempest-VolumesSnapshotsTestJSON-111050048 None] Deleting offline snapshot 69ec3e81-8923-4a52-a9b0-6d9dc74d3577 of volume da1f25bd-9da7-4838-8405-2f8556699b07 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 12:52:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [req-b3a9cb52-3353-449e-8a1b-c3f402d8bc1c req-8442a5da-ef22-4a3c-bc33-2a392a5d2e30 tempest-VolumesSnapshotsTestJSON-111050048 None] snapshot_file for this snap is: volume-da1f25bd-9da7-4838-8405-2f8556699b07.69ec3e81-8923-4a52-a9b0-6d9dc74d3577 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 12:52:59 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6955e8-3bd0-42ef-9a59-d48604e98917]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:52:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-b3a9cb52-3353-449e-8a1b-c3f402d8bc1c req-8442a5da-ef22-4a3c-bc33-2a392a5d2e30 tempest-VolumesSnapshotsTestJSON-111050048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07.69ec3e81-8923-4a52-a9b0-6d9dc74d3577 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:52:59 devstack sudo[84040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07.69ec3e81-8923-4a52-a9b0-6d9dc74d3577
Nov 19 12:52:59 devstack sudo[84040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:00 devstack sudo[84040]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-b3a9cb52-3353-449e-8a1b-c3f402d8bc1c req-8442a5da-ef22-4a3c-bc33-2a392a5d2e30 tempest-VolumesSnapshotsTestJSON-111050048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07.69ec3e81-8923-4a52-a9b0-6d9dc74d3577" returned: 0 in 0.709s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:00 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [req-b3a9cb52-3353-449e-8a1b-c3f402d8bc1c req-8442a5da-ef22-4a3c-bc33-2a392a5d2e30 tempest-VolumesSnapshotsTestJSON-111050048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da1f25bd-9da7-4838-8405-2f8556699b07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 12:53:00 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7677283f-d85a-4dc2-a237-a4a825bc13a0]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:53:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-b3a9cb52-3353-449e-8a1b-c3f402d8bc1c req-8442a5da-ef22-4a3c-bc33-2a392a5d2e30 tempest-VolumesSnapshotsTestJSON-111050048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:00 devstack sudo[84046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07
Nov 19 12:53:00 devstack sudo[84046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:00 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-8da41ae0-1a99-4b51-9635-30243fba0d76 req-65237639-2445-435f-b293-90ec632744a8 tempest-TaggedBootDevicesTest-2021980746 None] Terminate volume connection completed successfully.
Nov 19 12:53:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-8da41ae0-1a99-4b51-9635-30243fba0d76 req-65237639-2445-435f-b293-90ec632744a8 tempest-TaggedBootDevicesTest-2021980746 None] Deleting attachment a1d43e0f-869e-4c2d-a266-7d082c14bb34. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 12:53:00 devstack sudo[84046]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-b3a9cb52-3353-449e-8a1b-c3f402d8bc1c req-8442a5da-ef22-4a3c-bc33-2a392a5d2e30 tempest-VolumesSnapshotsTestJSON-111050048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07" returned: 0 in 0.642s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-b3a9cb52-3353-449e-8a1b-c3f402d8bc1c req-8442a5da-ef22-4a3c-bc33-2a392a5d2e30 tempest-VolumesSnapshotsTestJSON-111050048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07.69ec3e81-8923-4a52-a9b0-6d9dc74d3577 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:00 devstack sudo[84051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07.69ec3e81-8923-4a52-a9b0-6d9dc74d3577
Nov 19 12:53:00 devstack sudo[84051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-de9c433f-941d-4dd1-bc8f-abbffe73a744 req-c9bb1894-7455-4bd8-8251-ccbcc6171c67 tempest-TaggedBootDevicesTest_v242-995872979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-de9c433f-941d-4dd1-bc8f-abbffe73a744 req-c9bb1894-7455-4bd8-8251-ccbcc6171c67 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:01 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb52e9f-3c75-4471-b89a-4179f8aee47e]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:53:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-de9c433f-941d-4dd1-bc8f-abbffe73a744 req-c9bb1894-7455-4bd8-8251-ccbcc6171c67 tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:01 devstack sudo[84068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4
Nov 19 12:53:01 devstack sudo[84068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:01 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-8da41ae0-1a99-4b51-9635-30243fba0d76 req-d11aa7bc-3c8f-4401-8179-27bb6b69ae80 tempest-TaggedBootDevicesTest-2021980746 None] Terminate volume connection completed successfully.
Nov 19 12:53:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-8da41ae0-1a99-4b51-9635-30243fba0d76 req-d11aa7bc-3c8f-4401-8179-27bb6b69ae80 tempest-TaggedBootDevicesTest-2021980746 None] Deleting attachment b9891e45-4503-47bf-96b4-1fa1866b4400. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 12:53:01 devstack sudo[84051]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-b3a9cb52-3353-449e-8a1b-c3f402d8bc1c req-8442a5da-ef22-4a3c-bc33-2a392a5d2e30 tempest-VolumesSnapshotsTestJSON-111050048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07.69ec3e81-8923-4a52-a9b0-6d9dc74d3577" returned: 0 in 0.695s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-b3a9cb52-3353-449e-8a1b-c3f402d8bc1c req-8442a5da-ef22-4a3c-bc33-2a392a5d2e30 tempest-VolumesSnapshotsTestJSON-111050048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07.69ec3e81-8923-4a52-a9b0-6d9dc74d3577 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:01 devstack sudo[84070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07.69ec3e81-8923-4a52-a9b0-6d9dc74d3577
Nov 19 12:53:01 devstack sudo[84070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:02 devstack sudo[84068]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-de9c433f-941d-4dd1-bc8f-abbffe73a744 req-c9bb1894-7455-4bd8-8251-ccbcc6171c67 tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4" returned: 0 in 0.666s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-de9c433f-941d-4dd1-bc8f-abbffe73a744 req-c9bb1894-7455-4bd8-8251-ccbcc6171c67 tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:02 devstack sudo[84070]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-b3a9cb52-3353-449e-8a1b-c3f402d8bc1c req-8442a5da-ef22-4a3c-bc33-2a392a5d2e30 tempest-VolumesSnapshotsTestJSON-111050048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07.69ec3e81-8923-4a52-a9b0-6d9dc74d3577" returned: 0 in 0.587s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:02 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-b3a9cb52-3353-449e-8a1b-c3f402d8bc1c req-8442a5da-ef22-4a3c-bc33-2a392a5d2e30 tempest-VolumesSnapshotsTestJSON-111050048 None] Lock "cinder-quobyte-69ec3e81-8923-4a52-a9b0-6d9dc74d3577" released by "_delete_snapshot" :: held 2.711s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:53:02 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-b3a9cb52-3353-449e-8a1b-c3f402d8bc1c req-8442a5da-ef22-4a3c-bc33-2a392a5d2e30 tempest-VolumesSnapshotsTestJSON-111050048 None] Lock "cinder-quobyte-da1f25bd-9da7-4838-8405-2f8556699b07" released by "delete_snapshot" :: held 2.726s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:53:02 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-8da41ae0-1a99-4b51-9635-30243fba0d76 req-9e9dd2ec-ed76-4ac9-9cdb-9f9d7fd7442e tempest-TaggedBootDevicesTest-2021980746 None] Terminate volume connection completed successfully.
Nov 19 12:53:02 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-8da41ae0-1a99-4b51-9635-30243fba0d76 req-9e9dd2ec-ed76-4ac9-9cdb-9f9d7fd7442e tempest-TaggedBootDevicesTest-2021980746 None] Deleting attachment a210e676-93c5-4ce8-93fb-b68f614b4984. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 12:53:02 devstack sudo[84075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4
Nov 19 12:53:02 devstack sudo[84075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:02 devstack cinder-volume[80839]: WARNING cinder.quota [req-b3a9cb52-3353-449e-8a1b-c3f402d8bc1c req-8442a5da-ef22-4a3c-bc33-2a392a5d2e30 tempest-VolumesSnapshotsTestJSON-111050048 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 19 12:53:02 devstack cinder-volume[80839]: DEBUG cinder.quota [req-b3a9cb52-3353-449e-8a1b-c3f402d8bc1c req-8442a5da-ef22-4a3c-bc33-2a392a5d2e30 tempest-VolumesSnapshotsTestJSON-111050048 None] Created reservations ['b8de0160-903b-4be5-b8cf-6a2d619200b1', '26d45563-ecd5-4abb-a736-8c7b811544c5', 'b56ea51d-7071-4642-8e13-ba8460a707e9', '1c653fd0-0a52-442d-9152-39cc1ec57181'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:53:02 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-b3a9cb52-3353-449e-8a1b-c3f402d8bc1c req-8442a5da-ef22-4a3c-bc33-2a392a5d2e30 tempest-VolumesSnapshotsTestJSON-111050048 None] Delete snapshot completed successfully.
Nov 19 12:53:02 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-b3a9cb52-3353-449e-8a1b-c3f402d8bc1c req-8442a5da-ef22-4a3c-bc33-2a392a5d2e30 tempest-VolumesSnapshotsTestJSON-111050048 None] Lock "cinder-69ec3e81-8923-4a52-a9b0-6d9dc74d3577-delete_snapshot" released by "delete_snapshot" :: held 2.844s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:53:02 devstack sudo[84075]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-de9c433f-941d-4dd1-bc8f-abbffe73a744 req-c9bb1894-7455-4bd8-8251-ccbcc6171c67 tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4" returned: 1 in 0.792s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-de9c433f-941d-4dd1-bc8f-abbffe73a744 req-c9bb1894-7455-4bd8-8251-ccbcc6171c67 tempest-TaggedBootDevicesTest_v242-995872979 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 12:53:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-de9c433f-941d-4dd1-bc8f-abbffe73a744 req-c9bb1894-7455-4bd8-8251-ccbcc6171c67 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.490s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:02 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-de9c433f-941d-4dd1-bc8f-abbffe73a744 req-c9bb1894-7455-4bd8-8251-ccbcc6171c67 tempest-TaggedBootDevicesTest_v242-995872979 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-66f25197-d16c-4e7d-a464-ca749115b4e4', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23b5d9a5-6dfd-42ce-9a52-c807b05f44b1', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 12:53:03 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-de9c433f-941d-4dd1-bc8f-abbffe73a744 req-c9bb1894-7455-4bd8-8251-ccbcc6171c67 tempest-TaggedBootDevicesTest_v242-995872979 None] attachment_update completed successfully.
Nov 19 12:53:03 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-91eb6dac-90f8-46d7-815c-2e30cf990b5f req-31a878c0-6fd8-4172-8d58-31612288882e tempest-VolumesSnapshotsTestJSON-111050048 None] Acquiring lock "cinder-da1f25bd-9da7-4838-8405-2f8556699b07-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:53:03 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-91eb6dac-90f8-46d7-815c-2e30cf990b5f req-31a878c0-6fd8-4172-8d58-31612288882e tempest-VolumesSnapshotsTestJSON-111050048 None] Lock "cinder-da1f25bd-9da7-4838-8405-2f8556699b07-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:53:03 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-91eb6dac-90f8-46d7-815c-2e30cf990b5f req-31a878c0-6fd8-4172-8d58-31612288882e tempest-VolumesSnapshotsTestJSON-111050048 None] Acquiring lock "cinder-quobyte-da1f25bd-9da7-4838-8405-2f8556699b07" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:53:03 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-91eb6dac-90f8-46d7-815c-2e30cf990b5f req-31a878c0-6fd8-4172-8d58-31612288882e tempest-VolumesSnapshotsTestJSON-111050048 None] Lock "cinder-quobyte-da1f25bd-9da7-4838-8405-2f8556699b07" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:53:03 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[beaf172d-940d-44b9-81aa-12d559bc44c2]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:53:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-91eb6dac-90f8-46d7-815c-2e30cf990b5f req-31a878c0-6fd8-4172-8d58-31612288882e tempest-VolumesSnapshotsTestJSON-111050048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:03 devstack sudo[84141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07
Nov 19 12:53:03 devstack sudo[84141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:04 devstack sudo[84141]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-91eb6dac-90f8-46d7-815c-2e30cf990b5f req-31a878c0-6fd8-4172-8d58-31612288882e tempest-VolumesSnapshotsTestJSON-111050048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07" returned: 0 in 0.927s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-91eb6dac-90f8-46d7-815c-2e30cf990b5f req-31a878c0-6fd8-4172-8d58-31612288882e tempest-VolumesSnapshotsTestJSON-111050048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:04 devstack sudo[84147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07
Nov 19 12:53:04 devstack sudo[84147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 12:53:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:53:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:53:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:04 devstack sudo[84149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:53:04 devstack sudo[84149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-de9c433f-941d-4dd1-bc8f-abbffe73a744 req-ba14de23-c386-4e74-9a7e-c9a485a3deda tempest-TaggedBootDevicesTest_v242-995872979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-de9c433f-941d-4dd1-bc8f-abbffe73a744 req-ba14de23-c386-4e74-9a7e-c9a485a3deda tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:04 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5550e713-9f38-433f-a14d-1c7900fc6fad]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:53:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-de9c433f-941d-4dd1-bc8f-abbffe73a744 req-ba14de23-c386-4e74-9a7e-c9a485a3deda tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-445bd5af-207c-4c72-9eb8-d1189278de39 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:04 devstack sudo[84160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-445bd5af-207c-4c72-9eb8-d1189278de39
Nov 19 12:53:04 devstack sudo[84160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:05 devstack sudo[84149]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.968s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:05 devstack sudo[84147]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:05 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:53:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-91eb6dac-90f8-46d7-815c-2e30cf990b5f req-31a878c0-6fd8-4172-8d58-31612288882e tempest-VolumesSnapshotsTestJSON-111050048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da1f25bd-9da7-4838-8405-2f8556699b07" returned: 0 in 1.040s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:05 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-91eb6dac-90f8-46d7-815c-2e30cf990b5f req-31a878c0-6fd8-4172-8d58-31612288882e tempest-VolumesSnapshotsTestJSON-111050048 None] Lock "cinder-quobyte-da1f25bd-9da7-4838-8405-2f8556699b07" released by "delete_volume" :: held 2.041s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:53:05 devstack cinder-volume[80839]: DEBUG cinder.quota [req-91eb6dac-90f8-46d7-815c-2e30cf990b5f req-31a878c0-6fd8-4172-8d58-31612288882e tempest-VolumesSnapshotsTestJSON-111050048 None] Created reservations ['65aea0a8-3fbb-4603-9a99-7b425e414c61', '6560b152-b747-4b71-ba30-6fc1eb7c958f', 'cb1eecb8-a8a3-4b78-961e-5c91aa09948e', '2f3703e0-7b2d-44a3-8a0e-f0a24b96adf1'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:53:05 devstack sudo[84160]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-de9c433f-941d-4dd1-bc8f-abbffe73a744 req-ba14de23-c386-4e74-9a7e-c9a485a3deda tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-445bd5af-207c-4c72-9eb8-d1189278de39" returned: 0 in 0.780s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-de9c433f-941d-4dd1-bc8f-abbffe73a744 req-ba14de23-c386-4e74-9a7e-c9a485a3deda tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.794s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-91eb6dac-90f8-46d7-815c-2e30cf990b5f req-31a878c0-6fd8-4172-8d58-31612288882e tempest-VolumesSnapshotsTestJSON-111050048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-91eb6dac-90f8-46d7-815c-2e30cf990b5f req-31a878c0-6fd8-4172-8d58-31612288882e tempest-VolumesSnapshotsTestJSON-111050048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:05 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [req-91eb6dac-90f8-46d7-815c-2e30cf990b5f req-31a878c0-6fd8-4172-8d58-31612288882e tempest-VolumesSnapshotsTestJSON-111050048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:53:05 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [req-91eb6dac-90f8-46d7-815c-2e30cf990b5f req-31a878c0-6fd8-4172-8d58-31612288882e tempest-VolumesSnapshotsTestJSON-111050048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:53:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-91eb6dac-90f8-46d7-815c-2e30cf990b5f req-31a878c0-6fd8-4172-8d58-31612288882e tempest-VolumesSnapshotsTestJSON-111050048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-91eb6dac-90f8-46d7-815c-2e30cf990b5f req-31a878c0-6fd8-4172-8d58-31612288882e tempest-VolumesSnapshotsTestJSON-111050048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:05 devstack sudo[84168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:53:05 devstack sudo[84168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:05 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-de9c433f-941d-4dd1-bc8f-abbffe73a744 req-ba14de23-c386-4e74-9a7e-c9a485a3deda tempest-TaggedBootDevicesTest_v242-995872979 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-445bd5af-207c-4c72-9eb8-d1189278de39', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cf46b209-6f2b-497a-a2ae-31b5dd30eef2', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 12:53:05 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-de9c433f-941d-4dd1-bc8f-abbffe73a744 req-ba14de23-c386-4e74-9a7e-c9a485a3deda tempest-TaggedBootDevicesTest_v242-995872979 None] attachment_update completed successfully.
Nov 19 12:53:05 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:53:05 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Flow 'volume_create_manager' (b68a79cd-59aa-494f-b663-a51a502b3d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:53:05 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ae8b5dc-769b-41f6-a691-7f035f997295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ae8b5dc-769b-41f6-a691-7f035f997295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1384693219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20053f48-67f9-4393-b117-90d533decd2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d4ecef15ba94b35ae4e30490195d197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:53:06Z,use_quota=True,user_id='2107121c696c44a0b962a32c372be54f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (048d61c2-2ccb-4282-8810-e421278bdd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (048d61c2-2ccb-4282-8810-e421278bdd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2301d8f-020d-46c6-857c-9fb65b5fd053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2301d8f-020d-46c6-857c-9fb65b5fd053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20053f48-67f9-4393-b117-90d533decd2c', 'volume_name': 'volume-20053f48-67f9-4393-b117-90d533decd2c', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a48ab5-1408-49f9-bff7-41c24eabdec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a48ab5-1408-49f9-bff7-41c24eabdec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17616f4f-e2ae-4721-b125-9d601f41f9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:06 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Volume 20053f48-67f9-4393-b117-90d533decd2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20053f48-67f9-4393-b117-90d533decd2c', 'volume_size': 1}
Nov 19 12:53:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1384693219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20053f48-67f9-4393-b117-90d533decd2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d4ecef15ba94b35ae4e30490195d197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:53:06Z,use_quota=True,user_id='2107121c696c44a0b962a32c372be54f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:53:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Creating volume 20053f48-67f9-4393-b117-90d533decd2c {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:53:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:53:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:53:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:53:06 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:53:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-20053f48-67f9-4393-b117-90d533decd2c 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:06 devstack sudo[84170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-20053f48-67f9-4393-b117-90d533decd2c 1073741824
Nov 19 12:53:06 devstack sudo[84170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:06 devstack sudo[84168]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-91eb6dac-90f8-46d7-815c-2e30cf990b5f req-31a878c0-6fd8-4172-8d58-31612288882e tempest-VolumesSnapshotsTestJSON-111050048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.890s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:06 devstack cinder-volume[80839]: DEBUG cinder.manager [req-91eb6dac-90f8-46d7-815c-2e30cf990b5f req-31a878c0-6fd8-4172-8d58-31612288882e tempest-VolumesSnapshotsTestJSON-111050048 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:53:06 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-91eb6dac-90f8-46d7-815c-2e30cf990b5f req-31a878c0-6fd8-4172-8d58-31612288882e tempest-VolumesSnapshotsTestJSON-111050048 None] Deleted volume successfully.
Nov 19 12:53:06 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-91eb6dac-90f8-46d7-815c-2e30cf990b5f req-31a878c0-6fd8-4172-8d58-31612288882e tempest-VolumesSnapshotsTestJSON-111050048 None] Lock "cinder-da1f25bd-9da7-4838-8405-2f8556699b07-delete_volume" released by "delete_volume" :: held 3.202s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:53:07 devstack sudo[84170]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-20053f48-67f9-4393-b117-90d533decd2c 1073741824" returned: 0 in 0.971s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-20053f48-67f9-4393-b117-90d533decd2c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:07 devstack sudo[84177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-20053f48-67f9-4393-b117-90d533decd2c
Nov 19 12:53:07 devstack sudo[84177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-de9c433f-941d-4dd1-bc8f-abbffe73a744 req-47b7f083-0db7-48fd-91e5-a545b79470e1 tempest-TaggedBootDevicesTest_v242-995872979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:07 devstack sudo[84177]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-20053f48-67f9-4393-b117-90d533decd2c" returned: 0 in 0.771s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:53:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-de9c433f-941d-4dd1-bc8f-abbffe73a744 req-47b7f083-0db7-48fd-91e5-a545b79470e1 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.039s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17616f4f-e2ae-4721-b125-9d601f41f9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20053f48-67f9-4393-b117-90d533decd2c', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ebd6c68-af57-46eb-a2f8-ee20b6d01948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:07 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[58946f5e-7cec-4c50-b1c2-e5c7c62eb2f7]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:53:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-de9c433f-941d-4dd1-bc8f-abbffe73a744 req-47b7f083-0db7-48fd-91e5-a545b79470e1 tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4ce87d79-18f5-43dc-acb2-639edfb8dacc {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:07 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Volume volume-20053f48-67f9-4393-b117-90d533decd2c (20053f48-67f9-4393-b117-90d533decd2c): created successfully
Nov 19 12:53:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ebd6c68-af57-46eb-a2f8-ee20b6d01948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Flow 'volume_create_manager' (b68a79cd-59aa-494f-b663-a51a502b3d97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:53:07 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-1d71cfd2-d838-431e-9282-f4b392f12b4f tempest-DeleteServersTestJSON-598575260 None] Created volume successfully.
Nov 19 12:53:08 devstack sudo[84188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4ce87d79-18f5-43dc-acb2-639edfb8dacc
Nov 19 12:53:08 devstack sudo[84188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:08 devstack sudo[84188]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-de9c433f-941d-4dd1-bc8f-abbffe73a744 req-47b7f083-0db7-48fd-91e5-a545b79470e1 tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4ce87d79-18f5-43dc-acb2-639edfb8dacc" returned: 0 in 1.104s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-de9c433f-941d-4dd1-bc8f-abbffe73a744 req-47b7f083-0db7-48fd-91e5-a545b79470e1 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.127s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:08 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-de9c433f-941d-4dd1-bc8f-abbffe73a744 req-47b7f083-0db7-48fd-91e5-a545b79470e1 tempest-TaggedBootDevicesTest_v242-995872979 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-4ce87d79-18f5-43dc-acb2-639edfb8dacc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '890bf0f3-1967-4bd9-90d6-6f4741945989', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 12:53:09 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-de9c433f-941d-4dd1-bc8f-abbffe73a744 req-47b7f083-0db7-48fd-91e5-a545b79470e1 tempest-TaggedBootDevicesTest_v242-995872979 None] attachment_update completed successfully.
Nov 19 12:53:09 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:53:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Flow 'volume_create_manager' (f11395a6-115f-4819-bc88-f6a5eae2a5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:53:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56f1718d-6f6b-4b51-ad49-aff41cde1d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56f1718d-6f6b-4b51-ad49-aff41cde1d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1484291606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c26040cd-40cb-4806-a868-baeae15b7038,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8041f1eec9943e3893d4eab6079484f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:53:09Z,use_quota=True,user_id='9dbdd3cfe8de486eaff49989eae72c45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25cd8a80-e7e2-4931-911c-de93de5e2c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25cd8a80-e7e2-4931-911c-de93de5e2c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b3b024e-e937-4a40-9b9e-c2071d6ba4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b3b024e-e937-4a40-9b9e-c2071d6ba4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c26040cd-40cb-4806-a868-baeae15b7038', 'volume_name': 'volume-c26040cd-40cb-4806-a868-baeae15b7038', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe491fad-8910-473a-acae-a0e384a0c8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe491fad-8910-473a-acae-a0e384a0c8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95bc3345-2bf7-470a-848a-c54e9a92b45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:09 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Volume c26040cd-40cb-4806-a868-baeae15b7038: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c26040cd-40cb-4806-a868-baeae15b7038', 'volume_size': 1}
Nov 19 12:53:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:09 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1484291606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c26040cd-40cb-4806-a868-baeae15b7038,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8041f1eec9943e3893d4eab6079484f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:53:09Z,use_quota=True,user_id='9dbdd3cfe8de486eaff49989eae72c45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:53:09 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Creating volume c26040cd-40cb-4806-a868-baeae15b7038 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:53:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:09 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:53:09 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:53:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:09 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:53:09 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:53:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c26040cd-40cb-4806-a868-baeae15b7038 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:09 devstack sudo[84194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c26040cd-40cb-4806-a868-baeae15b7038 1073741824
Nov 19 12:53:09 devstack sudo[84194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:10 devstack sudo[84194]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c26040cd-40cb-4806-a868-baeae15b7038 1073741824" returned: 0 in 0.848s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c26040cd-40cb-4806-a868-baeae15b7038 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:10 devstack sudo[84201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c26040cd-40cb-4806-a868-baeae15b7038
Nov 19 12:53:10 devstack sudo[84201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-fe1153b2-f426-432d-a5a2-43eef528a864 tempest-TaggedBootDevicesTest-2021980746 None] Acquiring lock "cinder-31a75369-8a0a-49b2-aec4-07c641dc1a96-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:53:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-fe1153b2-f426-432d-a5a2-43eef528a864 tempest-TaggedBootDevicesTest-2021980746 None] Lock "cinder-31a75369-8a0a-49b2-aec4-07c641dc1a96-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:53:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-fe1153b2-f426-432d-a5a2-43eef528a864 tempest-TaggedBootDevicesTest-2021980746 None] Acquiring lock "cinder-quobyte-31a75369-8a0a-49b2-aec4-07c641dc1a96" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:53:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-fe1153b2-f426-432d-a5a2-43eef528a864 tempest-TaggedBootDevicesTest-2021980746 None] Lock "cinder-quobyte-31a75369-8a0a-49b2-aec4-07c641dc1a96" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:53:10 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c9b232-f717-4e19-a42c-df8a42de67dc]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:53:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fe1153b2-f426-432d-a5a2-43eef528a864 tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31a75369-8a0a-49b2-aec4-07c641dc1a96 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:10 devstack sudo[84205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31a75369-8a0a-49b2-aec4-07c641dc1a96
Nov 19 12:53:10 devstack sudo[84205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:11 devstack sudo[84201]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c26040cd-40cb-4806-a868-baeae15b7038" returned: 0 in 0.899s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:11 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:53:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95bc3345-2bf7-470a-848a-c54e9a92b45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c26040cd-40cb-4806-a868-baeae15b7038', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e808ec-eb9b-4113-8ef8-1cda4b2e9a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:11 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Volume volume-c26040cd-40cb-4806-a868-baeae15b7038 (c26040cd-40cb-4806-a868-baeae15b7038): created successfully
Nov 19 12:53:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e808ec-eb9b-4113-8ef8-1cda4b2e9a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Flow 'volume_create_manager' (f11395a6-115f-4819-bc88-f6a5eae2a5cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:53:11 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-b6196dda-d0a8-4106-9538-9e84c6b8d211 tempest-VolumesTestJSON-1753312507 None] Created volume successfully.
Nov 19 12:53:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-efc604c7-4dfe-4aec-8f0e-8567ba257083 req-b28325a9-a8b0-4e31-b056-328439be98a9 tempest-DeleteServersTestJSON-598575260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-efc604c7-4dfe-4aec-8f0e-8567ba257083 req-b28325a9-a8b0-4e31-b056-328439be98a9 tempest-DeleteServersTestJSON-598575260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:11 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3534f568-4675-43c1-b709-d95e6632766a]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:53:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-efc604c7-4dfe-4aec-8f0e-8567ba257083 req-b28325a9-a8b0-4e31-b056-328439be98a9 tempest-DeleteServersTestJSON-598575260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-20053f48-67f9-4393-b117-90d533decd2c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:11 devstack sudo[84216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-20053f48-67f9-4393-b117-90d533decd2c
Nov 19 12:53:11 devstack sudo[84216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:11 devstack sudo[84205]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fe1153b2-f426-432d-a5a2-43eef528a864 tempest-TaggedBootDevicesTest-2021980746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31a75369-8a0a-49b2-aec4-07c641dc1a96" returned: 0 in 0.787s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fe1153b2-f426-432d-a5a2-43eef528a864 tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31a75369-8a0a-49b2-aec4-07c641dc1a96 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:11 devstack sudo[84221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31a75369-8a0a-49b2-aec4-07c641dc1a96
Nov 19 12:53:11 devstack sudo[84221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:11 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:53:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Flow 'volume_create_manager' (5c46786b-6d77-45c1-bd76-4abc158599ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:53:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06078cc-87cb-4e19-b9aa-e545bbcb2ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06078cc-87cb-4e19-b9aa-e545bbcb2ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-681270620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf36dc0-3a2c-4488-bcb5-d4b470c88170,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8041f1eec9943e3893d4eab6079484f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:53:12Z,use_quota=True,user_id='9dbdd3cfe8de486eaff49989eae72c45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d770d01-a80d-47f3-9012-364cfbdc969e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d770d01-a80d-47f3-9012-364cfbdc969e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9e5f85a-dc6c-4184-bd52-31e807c1041d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9e5f85a-dc6c-4184-bd52-31e807c1041d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bf36dc0-3a2c-4488-bcb5-d4b470c88170', 'volume_name': 'volume-3bf36dc0-3a2c-4488-bcb5-d4b470c88170', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a93113b-536a-4c59-be27-45df28407960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a93113b-536a-4c59-be27-45df28407960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1334ba90-ab2a-480c-bcb7-fae23ab0fc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:11 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Volume 3bf36dc0-3a2c-4488-bcb5-d4b470c88170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bf36dc0-3a2c-4488-bcb5-d4b470c88170', 'volume_size': 1}
Nov 19 12:53:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:12 devstack sudo[84216]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-efc604c7-4dfe-4aec-8f0e-8567ba257083 req-b28325a9-a8b0-4e31-b056-328439be98a9 tempest-DeleteServersTestJSON-598575260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-20053f48-67f9-4393-b117-90d533decd2c" returned: 0 in 0.934s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-efc604c7-4dfe-4aec-8f0e-8567ba257083 req-b28325a9-a8b0-4e31-b056-328439be98a9 tempest-DeleteServersTestJSON-598575260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.947s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.278s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-681270620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf36dc0-3a2c-4488-bcb5-d4b470c88170,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8041f1eec9943e3893d4eab6079484f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:53:12Z,use_quota=True,user_id='9dbdd3cfe8de486eaff49989eae72c45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:53:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Creating volume 3bf36dc0-3a2c-4488-bcb5-d4b470c88170 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:53:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:53:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:53:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:53:12 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:53:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3bf36dc0-3a2c-4488-bcb5-d4b470c88170 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:12 devstack sudo[84221]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fe1153b2-f426-432d-a5a2-43eef528a864 tempest-TaggedBootDevicesTest-2021980746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31a75369-8a0a-49b2-aec4-07c641dc1a96" returned: 0 in 0.687s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:12 devstack sudo[84227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3bf36dc0-3a2c-4488-bcb5-d4b470c88170 1073741824
Nov 19 12:53:12 devstack sudo[84227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-fe1153b2-f426-432d-a5a2-43eef528a864 tempest-TaggedBootDevicesTest-2021980746 None] Lock "cinder-quobyte-31a75369-8a0a-49b2-aec4-07c641dc1a96" released by "delete_volume" :: held 1.508s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:53:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-efc604c7-4dfe-4aec-8f0e-8567ba257083 req-b28325a9-a8b0-4e31-b056-328439be98a9 tempest-DeleteServersTestJSON-598575260 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-20053f48-67f9-4393-b117-90d533decd2c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '033e5fff-6e5f-4d8b-a598-e59212cb6eb7', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 12:53:12 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-efc604c7-4dfe-4aec-8f0e-8567ba257083 req-b28325a9-a8b0-4e31-b056-328439be98a9 tempest-DeleteServersTestJSON-598575260 None] attachment_update completed successfully.
Nov 19 12:53:12 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-fe1153b2-f426-432d-a5a2-43eef528a864 tempest-TaggedBootDevicesTest-2021980746 None] Created reservations ['6e4dcf2e-0604-4577-9fb5-b001f1b5f120', '95479aa0-2d14-4d53-9c7c-690821060296', '75f0ab56-446b-4bcc-9d93-19eba8ac6e26', 'f042defa-8a0a-4964-824a-2bf9b7b1a981'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:53:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-fe1153b2-f426-432d-a5a2-43eef528a864 tempest-TaggedBootDevicesTest-2021980746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-fe1153b2-f426-432d-a5a2-43eef528a864 tempest-TaggedBootDevicesTest-2021980746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-fe1153b2-f426-432d-a5a2-43eef528a864 tempest-TaggedBootDevicesTest-2021980746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:53:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-fe1153b2-f426-432d-a5a2-43eef528a864 tempest-TaggedBootDevicesTest-2021980746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:53:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-fe1153b2-f426-432d-a5a2-43eef528a864 tempest-TaggedBootDevicesTest-2021980746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fe1153b2-f426-432d-a5a2-43eef528a864 tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:12 devstack sudo[84230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:53:12 devstack sudo[84230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-89b0e6d4-00b4-4a88-a863-1819744ff21d tempest-TaggedBootDevicesTest-2021980746 None] Acquiring lock "cinder-07456408-21a1-4b5e-a351-97522507535c-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:53:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-89b0e6d4-00b4-4a88-a863-1819744ff21d tempest-TaggedBootDevicesTest-2021980746 None] Lock "cinder-07456408-21a1-4b5e-a351-97522507535c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:53:13 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-89b0e6d4-00b4-4a88-a863-1819744ff21d tempest-TaggedBootDevicesTest-2021980746 None] Acquiring lock "cinder-quobyte-07456408-21a1-4b5e-a351-97522507535c" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:53:13 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-89b0e6d4-00b4-4a88-a863-1819744ff21d tempest-TaggedBootDevicesTest-2021980746 None] Lock "cinder-quobyte-07456408-21a1-4b5e-a351-97522507535c" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:53:13 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[99655985-7dff-4cd9-a790-a9ce7893def7]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:53:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-89b0e6d4-00b4-4a88-a863-1819744ff21d tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-07456408-21a1-4b5e-a351-97522507535c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:13 devstack sudo[84227]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3bf36dc0-3a2c-4488-bcb5-d4b470c88170 1073741824" returned: 0 in 0.896s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3bf36dc0-3a2c-4488-bcb5-d4b470c88170 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:13 devstack sudo[84304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3bf36dc0-3a2c-4488-bcb5-d4b470c88170
Nov 19 12:53:13 devstack sudo[84304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:13 devstack sudo[84303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-07456408-21a1-4b5e-a351-97522507535c
Nov 19 12:53:13 devstack sudo[84303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:13 devstack sudo[84230]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fe1153b2-f426-432d-a5a2-43eef528a864 tempest-TaggedBootDevicesTest-2021980746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.739s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:13 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-fe1153b2-f426-432d-a5a2-43eef528a864 tempest-TaggedBootDevicesTest-2021980746 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:53:13 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-fe1153b2-f426-432d-a5a2-43eef528a864 tempest-TaggedBootDevicesTest-2021980746 None] Deleted volume successfully.
Nov 19 12:53:13 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-fe1153b2-f426-432d-a5a2-43eef528a864 tempest-TaggedBootDevicesTest-2021980746 None] Lock "cinder-31a75369-8a0a-49b2-aec4-07c641dc1a96-delete_volume" released by "delete_volume" :: held 2.525s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:53:13 devstack sudo[84304]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3bf36dc0-3a2c-4488-bcb5-d4b470c88170" returned: 0 in 0.521s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:13 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:53:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:13 devstack sudo[84303]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-89b0e6d4-00b4-4a88-a863-1819744ff21d tempest-TaggedBootDevicesTest-2021980746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-07456408-21a1-4b5e-a351-97522507535c" returned: 0 in 0.595s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-89b0e6d4-00b4-4a88-a863-1819744ff21d tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-07456408-21a1-4b5e-a351-97522507535c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1334ba90-ab2a-480c-bcb7-fae23ab0fc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bf36dc0-3a2c-4488-bcb5-d4b470c88170', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e3b6c3-867b-4447-8385-151186876da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:13 devstack sudo[84628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-07456408-21a1-4b5e-a351-97522507535c
Nov 19 12:53:13 devstack sudo[84628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:13 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Volume volume-3bf36dc0-3a2c-4488-bcb5-d4b470c88170 (3bf36dc0-3a2c-4488-bcb5-d4b470c88170): created successfully
Nov 19 12:53:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e3b6c3-867b-4447-8385-151186876da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Flow 'volume_create_manager' (5c46786b-6d77-45c1-bd76-4abc158599ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:53:13 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-1fca5813-7ab7-42f6-8ba6-15609aa47356 tempest-VolumesTestJSON-1753312507 None] Created volume successfully.
Nov 19 12:53:14 devstack sudo[84628]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-89b0e6d4-00b4-4a88-a863-1819744ff21d tempest-TaggedBootDevicesTest-2021980746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-07456408-21a1-4b5e-a351-97522507535c" returned: 0 in 0.566s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-89b0e6d4-00b4-4a88-a863-1819744ff21d tempest-TaggedBootDevicesTest-2021980746 None] Lock "cinder-quobyte-07456408-21a1-4b5e-a351-97522507535c" released by "delete_volume" :: held 1.200s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-89b0e6d4-00b4-4a88-a863-1819744ff21d tempest-TaggedBootDevicesTest-2021980746 None] Created reservations ['f47bdbca-834f-40b7-b5cc-6b0b0d111e67', '1c2e5e35-b3f9-45ef-8e89-3f1bf6aa60af', 'e3b98ca7-6db2-4945-bf0c-ed9edcfcd5a5', '78c7768c-23a9-4711-b05f-737366cc9967'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Flow 'volume_create_manager' (9ed7d2e7-6ebe-4d86-baa4-227a37787aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfcdfd4d-c897-4c7b-a2c9-a1d328818d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-89b0e6d4-00b4-4a88-a863-1819744ff21d tempest-TaggedBootDevicesTest-2021980746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-89b0e6d4-00b4-4a88-a863-1819744ff21d tempest-TaggedBootDevicesTest-2021980746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-89b0e6d4-00b4-4a88-a863-1819744ff21d tempest-TaggedBootDevicesTest-2021980746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-89b0e6d4-00b4-4a88-a863-1819744ff21d tempest-TaggedBootDevicesTest-2021980746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-89b0e6d4-00b4-4a88-a863-1819744ff21d tempest-TaggedBootDevicesTest-2021980746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-89b0e6d4-00b4-4a88-a863-1819744ff21d tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:14 devstack sudo[84631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:53:14 devstack sudo[84631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfcdfd4d-c897-4c7b-a2c9-a1d328818d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-903156026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce514fe-044b-464c-b01f-8098df8a8aaa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8041f1eec9943e3893d4eab6079484f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:53:14Z,use_quota=True,user_id='9dbdd3cfe8de486eaff49989eae72c45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e201219b-8710-4d5c-9f49-47356773c1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e201219b-8710-4d5c-9f49-47356773c1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76cb8cd1-ddf2-461f-ab95-fa12b475abd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76cb8cd1-ddf2-461f-ab95-fa12b475abd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ce514fe-044b-464c-b01f-8098df8a8aaa', 'volume_name': 'volume-6ce514fe-044b-464c-b01f-8098df8a8aaa', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61df5faf-6ec4-4bfe-82bd-5ff71b72e572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61df5faf-6ec4-4bfe-82bd-5ff71b72e572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc3ea04-5e46-4c03-99a6-c852c34260d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:14 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Volume 6ce514fe-044b-464c-b01f-8098df8a8aaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ce514fe-044b-464c-b01f-8098df8a8aaa', 'volume_size': 1}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-903156026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce514fe-044b-464c-b01f-8098df8a8aaa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8041f1eec9943e3893d4eab6079484f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:53:14Z,use_quota=True,user_id='9dbdd3cfe8de486eaff49989eae72c45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Creating volume 6ce514fe-044b-464c-b01f-8098df8a8aaa {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:53:14 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6ce514fe-044b-464c-b01f-8098df8a8aaa 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:14 devstack sudo[84633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6ce514fe-044b-464c-b01f-8098df8a8aaa 1073741824
Nov 19 12:53:14 devstack sudo[84633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:14 devstack sudo[84631]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-89b0e6d4-00b4-4a88-a863-1819744ff21d tempest-TaggedBootDevicesTest-2021980746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.502s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-89b0e6d4-00b4-4a88-a863-1819744ff21d tempest-TaggedBootDevicesTest-2021980746 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:53:14 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-89b0e6d4-00b4-4a88-a863-1819744ff21d tempest-TaggedBootDevicesTest-2021980746 None] Deleted volume successfully.
Nov 19 12:53:14 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-89b0e6d4-00b4-4a88-a863-1819744ff21d tempest-TaggedBootDevicesTest-2021980746 None] Lock "cinder-07456408-21a1-4b5e-a351-97522507535c-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:53:15 devstack sudo[84633]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6ce514fe-044b-464c-b01f-8098df8a8aaa 1073741824" returned: 0 in 0.635s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6ce514fe-044b-464c-b01f-8098df8a8aaa {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:15 devstack sudo[84639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6ce514fe-044b-464c-b01f-8098df8a8aaa
Nov 19 12:53:15 devstack sudo[84639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:15 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5a414054-ec27-41cf-b710-e0e1c8e7b87a tempest-TaggedBootDevicesTest-2021980746 None] Acquiring lock "cinder-9ca56654-2444-449a-a91d-450cb1b4f257-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:53:15 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5a414054-ec27-41cf-b710-e0e1c8e7b87a tempest-TaggedBootDevicesTest-2021980746 None] Lock "cinder-9ca56654-2444-449a-a91d-450cb1b4f257-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:53:15 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5a414054-ec27-41cf-b710-e0e1c8e7b87a tempest-TaggedBootDevicesTest-2021980746 None] Acquiring lock "cinder-quobyte-9ca56654-2444-449a-a91d-450cb1b4f257" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:53:15 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5a414054-ec27-41cf-b710-e0e1c8e7b87a tempest-TaggedBootDevicesTest-2021980746 None] Lock "cinder-quobyte-9ca56654-2444-449a-a91d-450cb1b4f257" acquired by "delete_volume" :: waited 0.030s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:53:15 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf400e24-743a-480e-b998-76cdb1ee7fff]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:53:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5a414054-ec27-41cf-b710-e0e1c8e7b87a tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:15 devstack sudo[84641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257
Nov 19 12:53:15 devstack sudo[84641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:15 devstack sudo[84639]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6ce514fe-044b-464c-b01f-8098df8a8aaa" returned: 0 in 0.561s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:15 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:53:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc3ea04-5e46-4c03-99a6-c852c34260d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ce514fe-044b-464c-b01f-8098df8a8aaa', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ffede86-e828-47b4-b641-c4f27616f6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:15 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Volume volume-6ce514fe-044b-464c-b01f-8098df8a8aaa (6ce514fe-044b-464c-b01f-8098df8a8aaa): created successfully
Nov 19 12:53:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ffede86-e828-47b4-b641-c4f27616f6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Flow 'volume_create_manager' (9ed7d2e7-6ebe-4d86-baa4-227a37787aaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:53:15 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-449ec80e-6e4d-4eb7-b33e-13e7ce8da5a2 tempest-VolumesTestJSON-1753312507 None] Created volume successfully.
Nov 19 12:53:15 devstack sudo[84641]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5a414054-ec27-41cf-b710-e0e1c8e7b87a tempest-TaggedBootDevicesTest-2021980746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257" returned: 0 in 0.611s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5a414054-ec27-41cf-b710-e0e1c8e7b87a tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:16 devstack sudo[84646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257
Nov 19 12:53:16 devstack sudo[84646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:16 devstack sudo[84646]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5a414054-ec27-41cf-b710-e0e1c8e7b87a tempest-TaggedBootDevicesTest-2021980746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257" returned: 1 in 0.701s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5a414054-ec27-41cf-b710-e0e1c8e7b87a tempest-TaggedBootDevicesTest-2021980746 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 12:53:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5a414054-ec27-41cf-b710-e0e1c8e7b87a tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:16 devstack sudo[84651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257
Nov 19 12:53:16 devstack sudo[84651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:17 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-da0a2a95-5986-419a-b6e7-409afc8149e3 tempest-VolumesTestJSON-1753312507 None] Acquiring lock "cinder-6ce514fe-044b-464c-b01f-8098df8a8aaa-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:53:17 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-da0a2a95-5986-419a-b6e7-409afc8149e3 tempest-VolumesTestJSON-1753312507 None] Lock "cinder-6ce514fe-044b-464c-b01f-8098df8a8aaa-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:53:17 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-da0a2a95-5986-419a-b6e7-409afc8149e3 tempest-VolumesTestJSON-1753312507 None] Acquiring lock "cinder-quobyte-6ce514fe-044b-464c-b01f-8098df8a8aaa" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:53:17 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-da0a2a95-5986-419a-b6e7-409afc8149e3 tempest-VolumesTestJSON-1753312507 None] Lock "cinder-quobyte-6ce514fe-044b-464c-b01f-8098df8a8aaa" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:53:17 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9967dc14-2945-4717-b5fc-249aff237577]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:53:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-da0a2a95-5986-419a-b6e7-409afc8149e3 tempest-VolumesTestJSON-1753312507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6ce514fe-044b-464c-b01f-8098df8a8aaa {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:17 devstack sudo[84651]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5a414054-ec27-41cf-b710-e0e1c8e7b87a tempest-TaggedBootDevicesTest-2021980746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ca56654-2444-449a-a91d-450cb1b4f257" returned: 0 in 0.861s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:17 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5a414054-ec27-41cf-b710-e0e1c8e7b87a tempest-TaggedBootDevicesTest-2021980746 None] Lock "cinder-quobyte-9ca56654-2444-449a-a91d-450cb1b4f257" released by "delete_volume" :: held 2.247s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:53:17 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-5a414054-ec27-41cf-b710-e0e1c8e7b87a tempest-TaggedBootDevicesTest-2021980746 None] Created reservations ['6da54974-ba36-4133-88b8-34721f107607', 'd955e787-4788-4001-a0cf-ea6d6b8e0b49', 'f5f3c143-836f-4af7-983a-1dafa7a97941', '9778a69f-9bfa-4b97-984e-8d534f66a959'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:53:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5a414054-ec27-41cf-b710-e0e1c8e7b87a tempest-TaggedBootDevicesTest-2021980746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5a414054-ec27-41cf-b710-e0e1c8e7b87a tempest-TaggedBootDevicesTest-2021980746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5a414054-ec27-41cf-b710-e0e1c8e7b87a tempest-TaggedBootDevicesTest-2021980746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:53:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5a414054-ec27-41cf-b710-e0e1c8e7b87a tempest-TaggedBootDevicesTest-2021980746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:53:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5a414054-ec27-41cf-b710-e0e1c8e7b87a tempest-TaggedBootDevicesTest-2021980746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5a414054-ec27-41cf-b710-e0e1c8e7b87a tempest-TaggedBootDevicesTest-2021980746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:17 devstack sudo[84654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6ce514fe-044b-464c-b01f-8098df8a8aaa
Nov 19 12:53:17 devstack sudo[84654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:17 devstack sudo[84656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:53:17 devstack sudo[84656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:18 devstack sudo[84656]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5a414054-ec27-41cf-b710-e0e1c8e7b87a tempest-TaggedBootDevicesTest-2021980746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.570s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:18 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-5a414054-ec27-41cf-b710-e0e1c8e7b87a tempest-TaggedBootDevicesTest-2021980746 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:53:18 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-5a414054-ec27-41cf-b710-e0e1c8e7b87a tempest-TaggedBootDevicesTest-2021980746 None] Deleted volume successfully.
Nov 19 12:53:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5a414054-ec27-41cf-b710-e0e1c8e7b87a tempest-TaggedBootDevicesTest-2021980746 None] Lock "cinder-9ca56654-2444-449a-a91d-450cb1b4f257-delete_volume" released by "delete_volume" :: held 3.046s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:53:18 devstack sudo[84654]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-da0a2a95-5986-419a-b6e7-409afc8149e3 tempest-VolumesTestJSON-1753312507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6ce514fe-044b-464c-b01f-8098df8a8aaa" returned: 0 in 0.746s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-da0a2a95-5986-419a-b6e7-409afc8149e3 tempest-VolumesTestJSON-1753312507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6ce514fe-044b-464c-b01f-8098df8a8aaa {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:18 devstack sudo[84698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6ce514fe-044b-464c-b01f-8098df8a8aaa
Nov 19 12:53:18 devstack sudo[84698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:18 devstack sudo[84698]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-da0a2a95-5986-419a-b6e7-409afc8149e3 tempest-VolumesTestJSON-1753312507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6ce514fe-044b-464c-b01f-8098df8a8aaa" returned: 0 in 0.613s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-da0a2a95-5986-419a-b6e7-409afc8149e3 tempest-VolumesTestJSON-1753312507 None] Lock "cinder-quobyte-6ce514fe-044b-464c-b01f-8098df8a8aaa" released by "delete_volume" :: held 1.384s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:53:18 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-da0a2a95-5986-419a-b6e7-409afc8149e3 tempest-VolumesTestJSON-1753312507 None] Created reservations ['67542702-46b2-4202-a0e8-47e7469799a0', '260d7f6e-fec8-47ff-9aff-bf685b4c7924', '39669937-19dd-4353-8e32-76bbfd791bdb', '25a47bac-e3c9-4819-aab1-02e993ef9ce2'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:53:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-da0a2a95-5986-419a-b6e7-409afc8149e3 tempest-VolumesTestJSON-1753312507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-da0a2a95-5986-419a-b6e7-409afc8149e3 tempest-VolumesTestJSON-1753312507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-da0a2a95-5986-419a-b6e7-409afc8149e3 tempest-VolumesTestJSON-1753312507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:53:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-da0a2a95-5986-419a-b6e7-409afc8149e3 tempest-VolumesTestJSON-1753312507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:53:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-da0a2a95-5986-419a-b6e7-409afc8149e3 tempest-VolumesTestJSON-1753312507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-da0a2a95-5986-419a-b6e7-409afc8149e3 tempest-VolumesTestJSON-1753312507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:18 devstack sudo[84727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:53:18 devstack sudo[84727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:19 devstack sudo[84727]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-da0a2a95-5986-419a-b6e7-409afc8149e3 tempest-VolumesTestJSON-1753312507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.524s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:19 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-da0a2a95-5986-419a-b6e7-409afc8149e3 tempest-VolumesTestJSON-1753312507 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:53:19 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-da0a2a95-5986-419a-b6e7-409afc8149e3 tempest-VolumesTestJSON-1753312507 None] Deleted volume successfully.
Nov 19 12:53:19 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-da0a2a95-5986-419a-b6e7-409afc8149e3 tempest-VolumesTestJSON-1753312507 None] Lock "cinder-6ce514fe-044b-464c-b01f-8098df8a8aaa-delete_volume" released by "delete_volume" :: held 2.138s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:53:19 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-ba933cae-9859-4c92-8ff8-ed7cc09f5736 tempest-VolumesTestJSON-1753312507 None] Acquiring lock "cinder-3bf36dc0-3a2c-4488-bcb5-d4b470c88170-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:53:19 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-ba933cae-9859-4c92-8ff8-ed7cc09f5736 tempest-VolumesTestJSON-1753312507 None] Lock "cinder-3bf36dc0-3a2c-4488-bcb5-d4b470c88170-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:53:19 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-ba933cae-9859-4c92-8ff8-ed7cc09f5736 tempest-VolumesTestJSON-1753312507 None] Acquiring lock "cinder-quobyte-3bf36dc0-3a2c-4488-bcb5-d4b470c88170" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:53:19 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-ba933cae-9859-4c92-8ff8-ed7cc09f5736 tempest-VolumesTestJSON-1753312507 None] Lock "cinder-quobyte-3bf36dc0-3a2c-4488-bcb5-d4b470c88170" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:53:19 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1526c9-35d6-47f0-921a-02bb0d6f889f]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:53:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ba933cae-9859-4c92-8ff8-ed7cc09f5736 tempest-VolumesTestJSON-1753312507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3bf36dc0-3a2c-4488-bcb5-d4b470c88170 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:19 devstack sudo[84798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3bf36dc0-3a2c-4488-bcb5-d4b470c88170
Nov 19 12:53:19 devstack sudo[84798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:20 devstack sudo[84798]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ba933cae-9859-4c92-8ff8-ed7cc09f5736 tempest-VolumesTestJSON-1753312507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3bf36dc0-3a2c-4488-bcb5-d4b470c88170" returned: 0 in 0.585s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ba933cae-9859-4c92-8ff8-ed7cc09f5736 tempest-VolumesTestJSON-1753312507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3bf36dc0-3a2c-4488-bcb5-d4b470c88170 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:20 devstack sudo[84803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3bf36dc0-3a2c-4488-bcb5-d4b470c88170
Nov 19 12:53:20 devstack sudo[84803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:20 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-fd1b288a-45cf-4406-a313-f3ebb56cbca6 req-cf30bab1-fff5-4188-aac3-172b9b37b63e tempest-DeleteServersTestJSON-598575260 None] Terminate volume connection completed successfully.
Nov 19 12:53:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-fd1b288a-45cf-4406-a313-f3ebb56cbca6 req-cf30bab1-fff5-4188-aac3-172b9b37b63e tempest-DeleteServersTestJSON-598575260 None] Deleting attachment 033e5fff-6e5f-4d8b-a598-e59212cb6eb7. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 12:53:20 devstack sudo[84803]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ba933cae-9859-4c92-8ff8-ed7cc09f5736 tempest-VolumesTestJSON-1753312507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3bf36dc0-3a2c-4488-bcb5-d4b470c88170" returned: 0 in 0.556s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-ba933cae-9859-4c92-8ff8-ed7cc09f5736 tempest-VolumesTestJSON-1753312507 None] Lock "cinder-quobyte-3bf36dc0-3a2c-4488-bcb5-d4b470c88170" released by "delete_volume" :: held 1.164s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:53:20 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-ba933cae-9859-4c92-8ff8-ed7cc09f5736 tempest-VolumesTestJSON-1753312507 None] Created reservations ['03667762-b828-4148-83f1-620df5c6bcb8', '623f69d7-7a7c-427a-b946-6f1ca3facd86', 'b81a8e95-6f27-423c-9cfc-1ed1197f0244', '9f945a33-a446-4966-a531-a7dde6d0fdb5'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:53:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ba933cae-9859-4c92-8ff8-ed7cc09f5736 tempest-VolumesTestJSON-1753312507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ba933cae-9859-4c92-8ff8-ed7cc09f5736 tempest-VolumesTestJSON-1753312507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ba933cae-9859-4c92-8ff8-ed7cc09f5736 tempest-VolumesTestJSON-1753312507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:53:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ba933cae-9859-4c92-8ff8-ed7cc09f5736 tempest-VolumesTestJSON-1753312507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:53:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ba933cae-9859-4c92-8ff8-ed7cc09f5736 tempest-VolumesTestJSON-1753312507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ba933cae-9859-4c92-8ff8-ed7cc09f5736 tempest-VolumesTestJSON-1753312507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:20 devstack sudo[84806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:53:20 devstack sudo[84806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:21 devstack sudo[84806]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ba933cae-9859-4c92-8ff8-ed7cc09f5736 tempest-VolumesTestJSON-1753312507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.580s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:21 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-ba933cae-9859-4c92-8ff8-ed7cc09f5736 tempest-VolumesTestJSON-1753312507 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:53:21 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-ba933cae-9859-4c92-8ff8-ed7cc09f5736 tempest-VolumesTestJSON-1753312507 None] Deleted volume successfully.
Nov 19 12:53:21 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-ba933cae-9859-4c92-8ff8-ed7cc09f5736 tempest-VolumesTestJSON-1753312507 None] Lock "cinder-3bf36dc0-3a2c-4488-bcb5-d4b470c88170-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:53:21 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-19f17adb-8fa6-4d79-9bcc-fc5511587a5e tempest-VolumesTestJSON-1753312507 None] Acquiring lock "cinder-c26040cd-40cb-4806-a868-baeae15b7038-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:53:21 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-19f17adb-8fa6-4d79-9bcc-fc5511587a5e tempest-VolumesTestJSON-1753312507 None] Lock "cinder-c26040cd-40cb-4806-a868-baeae15b7038-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:53:21 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-19f17adb-8fa6-4d79-9bcc-fc5511587a5e tempest-VolumesTestJSON-1753312507 None] Acquiring lock "cinder-quobyte-c26040cd-40cb-4806-a868-baeae15b7038" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:53:21 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-19f17adb-8fa6-4d79-9bcc-fc5511587a5e tempest-VolumesTestJSON-1753312507 None] Lock "cinder-quobyte-c26040cd-40cb-4806-a868-baeae15b7038" acquired by "delete_volume" :: waited 0.014s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:53:21 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[47abe8e9-d503-4370-9a08-042bca254527]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:53:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-19f17adb-8fa6-4d79-9bcc-fc5511587a5e tempest-VolumesTestJSON-1753312507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c26040cd-40cb-4806-a868-baeae15b7038 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:22 devstack sudo[84909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c26040cd-40cb-4806-a868-baeae15b7038
Nov 19 12:53:22 devstack sudo[84909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:22 devstack sudo[84909]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-19f17adb-8fa6-4d79-9bcc-fc5511587a5e tempest-VolumesTestJSON-1753312507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c26040cd-40cb-4806-a868-baeae15b7038" returned: 0 in 0.660s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-19f17adb-8fa6-4d79-9bcc-fc5511587a5e tempest-VolumesTestJSON-1753312507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c26040cd-40cb-4806-a868-baeae15b7038 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:22 devstack sudo[84916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c26040cd-40cb-4806-a868-baeae15b7038
Nov 19 12:53:22 devstack sudo[84916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:23 devstack sudo[84916]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-19f17adb-8fa6-4d79-9bcc-fc5511587a5e tempest-VolumesTestJSON-1753312507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c26040cd-40cb-4806-a868-baeae15b7038" returned: 0 in 0.517s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-19f17adb-8fa6-4d79-9bcc-fc5511587a5e tempest-VolumesTestJSON-1753312507 None] Lock "cinder-quobyte-c26040cd-40cb-4806-a868-baeae15b7038" released by "delete_volume" :: held 1.219s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:53:23 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-19f17adb-8fa6-4d79-9bcc-fc5511587a5e tempest-VolumesTestJSON-1753312507 None] Created reservations ['e568d1fa-37eb-4d45-aea3-34f71a7e30e0', 'd0a60f9c-458f-4fc2-a2d0-2f9fbe76e36c', 'd410a83d-4b9a-4822-b4cc-17dda93f1250', '62c28faa-f4a6-476c-86da-d2b3f614bdfb'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:53:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-19f17adb-8fa6-4d79-9bcc-fc5511587a5e tempest-VolumesTestJSON-1753312507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-19f17adb-8fa6-4d79-9bcc-fc5511587a5e tempest-VolumesTestJSON-1753312507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-19f17adb-8fa6-4d79-9bcc-fc5511587a5e tempest-VolumesTestJSON-1753312507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:53:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-19f17adb-8fa6-4d79-9bcc-fc5511587a5e tempest-VolumesTestJSON-1753312507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:53:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-19f17adb-8fa6-4d79-9bcc-fc5511587a5e tempest-VolumesTestJSON-1753312507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-19f17adb-8fa6-4d79-9bcc-fc5511587a5e tempest-VolumesTestJSON-1753312507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:23 devstack sudo[84919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:53:23 devstack sudo[84919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:23 devstack sudo[84919]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-19f17adb-8fa6-4d79-9bcc-fc5511587a5e tempest-VolumesTestJSON-1753312507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.537s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:23 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-19f17adb-8fa6-4d79-9bcc-fc5511587a5e tempest-VolumesTestJSON-1753312507 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:53:23 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-19f17adb-8fa6-4d79-9bcc-fc5511587a5e tempest-VolumesTestJSON-1753312507 None] Deleted volume successfully.
Nov 19 12:53:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-19f17adb-8fa6-4d79-9bcc-fc5511587a5e tempest-VolumesTestJSON-1753312507 None] Lock "cinder-c26040cd-40cb-4806-a868-baeae15b7038-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:53:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-13fc3867-cc23-4644-82a3-b55d696ff431 tempest-DeleteServersTestJSON-598575260 None] Acquiring lock "cinder-20053f48-67f9-4393-b117-90d533decd2c-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:53:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-13fc3867-cc23-4644-82a3-b55d696ff431 tempest-DeleteServersTestJSON-598575260 None] Lock "cinder-20053f48-67f9-4393-b117-90d533decd2c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:53:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-13fc3867-cc23-4644-82a3-b55d696ff431 tempest-DeleteServersTestJSON-598575260 None] Acquiring lock "cinder-quobyte-20053f48-67f9-4393-b117-90d533decd2c" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:53:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-13fc3867-cc23-4644-82a3-b55d696ff431 tempest-DeleteServersTestJSON-598575260 None] Lock "cinder-quobyte-20053f48-67f9-4393-b117-90d533decd2c" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:53:23 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb1c323-7a61-4b2d-b712-fbf3b9638e9f]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:53:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-13fc3867-cc23-4644-82a3-b55d696ff431 tempest-DeleteServersTestJSON-598575260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-20053f48-67f9-4393-b117-90d533decd2c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:24 devstack sudo[84922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-20053f48-67f9-4393-b117-90d533decd2c
Nov 19 12:53:24 devstack sudo[84922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:25 devstack sudo[84922]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-13fc3867-cc23-4644-82a3-b55d696ff431 tempest-DeleteServersTestJSON-598575260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-20053f48-67f9-4393-b117-90d533decd2c" returned: 0 in 1.373s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-13fc3867-cc23-4644-82a3-b55d696ff431 tempest-DeleteServersTestJSON-598575260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-20053f48-67f9-4393-b117-90d533decd2c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:25 devstack sudo[85358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-20053f48-67f9-4393-b117-90d533decd2c
Nov 19 12:53:25 devstack sudo[85358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:26 devstack sudo[85358]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-13fc3867-cc23-4644-82a3-b55d696ff431 tempest-DeleteServersTestJSON-598575260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-20053f48-67f9-4393-b117-90d533decd2c" returned: 0 in 0.807s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-13fc3867-cc23-4644-82a3-b55d696ff431 tempest-DeleteServersTestJSON-598575260 None] Lock "cinder-quobyte-20053f48-67f9-4393-b117-90d533decd2c" released by "delete_volume" :: held 2.219s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:53:26 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-13fc3867-cc23-4644-82a3-b55d696ff431 tempest-DeleteServersTestJSON-598575260 None] Created reservations ['20c0ea43-cbcc-404c-9017-896134bfdc1f', '2a361266-7b8a-4498-8733-14e737a6d6c0', '8779dccd-d3b1-42b4-8b05-88142dfa0f9d', '4f934edb-119b-48a8-bb56-b84535b861b7'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:53:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-13fc3867-cc23-4644-82a3-b55d696ff431 tempest-DeleteServersTestJSON-598575260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-13fc3867-cc23-4644-82a3-b55d696ff431 tempest-DeleteServersTestJSON-598575260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-13fc3867-cc23-4644-82a3-b55d696ff431 tempest-DeleteServersTestJSON-598575260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:53:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-13fc3867-cc23-4644-82a3-b55d696ff431 tempest-DeleteServersTestJSON-598575260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:53:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-13fc3867-cc23-4644-82a3-b55d696ff431 tempest-DeleteServersTestJSON-598575260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-13fc3867-cc23-4644-82a3-b55d696ff431 tempest-DeleteServersTestJSON-598575260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:26 devstack sudo[85407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:53:26 devstack sudo[85407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:26 devstack sudo[85407]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-13fc3867-cc23-4644-82a3-b55d696ff431 tempest-DeleteServersTestJSON-598575260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.653s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:26 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-13fc3867-cc23-4644-82a3-b55d696ff431 tempest-DeleteServersTestJSON-598575260 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:53:26 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-13fc3867-cc23-4644-82a3-b55d696ff431 tempest-DeleteServersTestJSON-598575260 None] Deleted volume successfully.
Nov 19 12:53:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-13fc3867-cc23-4644-82a3-b55d696ff431 tempest-DeleteServersTestJSON-598575260 None] Lock "cinder-20053f48-67f9-4393-b117-90d533decd2c-delete_volume" released by "delete_volume" :: held 3.114s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:53:29 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-b399fed8-1b9d-4704-b4cc-3498c2818635 tempest-GroupSnapshotsV319Test-1732204612 None] Group tempest-GroupSnapshotsV319Test-Group-14478774: creating
Nov 19 12:53:29 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-b399fed8-1b9d-4704-b4cc-3498c2818635 tempest-GroupSnapshotsV319Test-1732204612 None] Group tempest-GroupSnapshotsV319Test-Group-14478774: created successfully
Nov 19 12:53:29 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-b399fed8-1b9d-4704-b4cc-3498c2818635 tempest-GroupSnapshotsV319Test-1732204612 None] Create group completed successfully.
Nov 19 12:53:30 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:53:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Flow 'volume_create_manager' (948ed609-9ec2-4778-8fbc-912c4dfacd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:53:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (136b79a5-48a5-4683-95ec-267d1335400b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (136b79a5-48a5-4683-95ec-267d1335400b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1058909598',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=69c02b21-f4d0-406b-91f9-c068b5f8a53c,host='devstack@QuobyteHD#QuobyteHD',id=422662b3-1994-42cc-99b2-d75146c32741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a198fa77e3540f88bbcd2ac148edbab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:53:31Z,use_quota=True,user_id='a9738ad26fc84391b8362924135b36ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3daaa230-e4a6-4b02-b7aa-fb57f821de97),volume_type_id=3daaa230-e4a6-4b02-b7aa-fb57f821de97)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0e2b4e-cda6-4210-bf67-ba1bcad3056d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0e2b4e-cda6-4210-bf67-ba1bcad3056d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b41988ad-ec44-4223-8169-28d31f0050f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b41988ad-ec44-4223-8169-28d31f0050f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '422662b3-1994-42cc-99b2-d75146c32741', 'volume_name': 'volume-422662b3-1994-42cc-99b2-d75146c32741', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95af3d27-7f80-41eb-b38c-d15e65651ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95af3d27-7f80-41eb-b38c-d15e65651ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4ca4b9-13de-40f3-b392-74b01e9b408a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:30 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Volume 422662b3-1994-42cc-99b2-d75146c32741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-422662b3-1994-42cc-99b2-d75146c32741', 'volume_size': 1}
Nov 19 12:53:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=69c02b21-f4d0-406b-91f9-c068b5f8a53c,created_at=2025-11-19T11:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1058909598',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=69c02b21-f4d0-406b-91f9-c068b5f8a53c,host='devstack@QuobyteHD#QuobyteHD',id=422662b3-1994-42cc-99b2-d75146c32741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a198fa77e3540f88bbcd2ac148edbab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:53:31Z,use_quota=True,user_id='a9738ad26fc84391b8362924135b36ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3daaa230-e4a6-4b02-b7aa-fb57f821de97),volume_type_id=3daaa230-e4a6-4b02-b7aa-fb57f821de97)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:53:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Creating volume 422662b3-1994-42cc-99b2-d75146c32741 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:53:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:53:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:53:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:53:30 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:53:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:30 devstack sudo[85494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741 1073741824
Nov 19 12:53:30 devstack sudo[85494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:31 devstack sudo[85494]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741 1073741824" returned: 0 in 0.892s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:31 devstack sudo[85500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741
Nov 19 12:53:31 devstack sudo[85500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:32 devstack sudo[85500]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741" returned: 0 in 0.738s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:32 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:53:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:32 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4ca4b9-13de-40f3-b392-74b01e9b408a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-422662b3-1994-42cc-99b2-d75146c32741', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:32 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40747aa-dfd3-44ac-a75c-29a8f7439c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:32 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Volume volume-422662b3-1994-42cc-99b2-d75146c32741 (422662b3-1994-42cc-99b2-d75146c32741): created successfully
Nov 19 12:53:32 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40747aa-dfd3-44ac-a75c-29a8f7439c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:32 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Flow 'volume_create_manager' (948ed609-9ec2-4778-8fbc-912c4dfacd8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:53:32 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-0c32c707-61de-47e5-a1b3-dc9aaae3c63e tempest-GroupSnapshotsV319Test-1732204612 None] Created volume successfully.
Nov 19 12:53:33 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-b999c1d0-1587-4d32-ac2d-5f80d31240e9 tempest-GroupSnapshotsV319Test-1732204612 None] GroupSnapshot 7327d8c8-dc17-4d4a-84bd-370faba9728a: creating.
Nov 19 12:53:33 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b999c1d0-1587-4d32-ac2d-5f80d31240e9 tempest-GroupSnapshotsV319Test-1732204612 None] Group snapshot 7327d8c8-dc17-4d4a-84bd-370faba9728a: creating. {{(pid=80839) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4143}}
Nov 19 12:53:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b999c1d0-1587-4d32-ac2d-5f80d31240e9 tempest-GroupSnapshotsV319Test-1732204612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b999c1d0-1587-4d32-ac2d-5f80d31240e9 tempest-GroupSnapshotsV319Test-1732204612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:33 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-b999c1d0-1587-4d32-ac2d-5f80d31240e9 tempest-GroupSnapshotsV319Test-1732204612 None] Creating offline snapshot 3b26b2f0-6bca-4b75-b4bd-ee64a43bb2a0 of volume 422662b3-1994-42cc-99b2-d75146c32741 {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 12:53:33 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[71205f5e-ab63-4f77-8159-32e5a6fc21ac]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:53:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b999c1d0-1587-4d32-ac2d-5f80d31240e9 tempest-GroupSnapshotsV319Test-1732204612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:33 devstack sudo[85505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741
Nov 19 12:53:33 devstack sudo[85505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:34 devstack sudo[85505]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b999c1d0-1587-4d32-ac2d-5f80d31240e9 tempest-GroupSnapshotsV319Test-1732204612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741" returned: 0 in 0.859s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b999c1d0-1587-4d32-ac2d-5f80d31240e9 tempest-GroupSnapshotsV319Test-1732204612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741.3b26b2f0-6bca-4b75-b4bd-ee64a43bb2a0 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:34 devstack sudo[85511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741.3b26b2f0-6bca-4b75-b4bd-ee64a43bb2a0 1G
Nov 19 12:53:34 devstack sudo[85511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:35 devstack sudo[85511]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b999c1d0-1587-4d32-ac2d-5f80d31240e9 tempest-GroupSnapshotsV319Test-1732204612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741.3b26b2f0-6bca-4b75-b4bd-ee64a43bb2a0 1G" returned: 0 in 0.664s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b999c1d0-1587-4d32-ac2d-5f80d31240e9 tempest-GroupSnapshotsV319Test-1732204612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-422662b3-1994-42cc-99b2-d75146c32741 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741.3b26b2f0-6bca-4b75-b4bd-ee64a43bb2a0 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:35 devstack sudo[85522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-422662b3-1994-42cc-99b2-d75146c32741 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741.3b26b2f0-6bca-4b75-b4bd-ee64a43bb2a0
Nov 19 12:53:35 devstack sudo[85522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:35 devstack sudo[85522]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b999c1d0-1587-4d32-ac2d-5f80d31240e9 tempest-GroupSnapshotsV319Test-1732204612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-422662b3-1994-42cc-99b2-d75146c32741 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741.3b26b2f0-6bca-4b75-b4bd-ee64a43bb2a0" returned: 0 in 0.624s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:35 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-b999c1d0-1587-4d32-ac2d-5f80d31240e9 tempest-GroupSnapshotsV319Test-1732204612 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741.3b26b2f0-6bca-4b75-b4bd-ee64a43bb2a0 is being set with open permissions: ugo+rw: NotImplementedError
Nov 19 12:53:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b999c1d0-1587-4d32-ac2d-5f80d31240e9 tempest-GroupSnapshotsV319Test-1732204612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741.3b26b2f0-6bca-4b75-b4bd-ee64a43bb2a0 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:35 devstack sudo[85527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741.3b26b2f0-6bca-4b75-b4bd-ee64a43bb2a0
Nov 19 12:53:35 devstack sudo[85527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:36 devstack sudo[85527]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b999c1d0-1587-4d32-ac2d-5f80d31240e9 tempest-GroupSnapshotsV319Test-1732204612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741.3b26b2f0-6bca-4b75-b4bd-ee64a43bb2a0" returned: 0 in 0.736s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b999c1d0-1587-4d32-ac2d-5f80d31240e9 tempest-GroupSnapshotsV319Test-1732204612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:36 devstack sudo[85530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741.info
Nov 19 12:53:36 devstack sudo[85530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:37 devstack sudo[85530]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b999c1d0-1587-4d32-ac2d-5f80d31240e9 tempest-GroupSnapshotsV319Test-1732204612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741.info" returned: 0 in 0.555s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:37 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-b999c1d0-1587-4d32-ac2d-5f80d31240e9 tempest-GroupSnapshotsV319Test-1732204612 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 19 12:53:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b999c1d0-1587-4d32-ac2d-5f80d31240e9 tempest-GroupSnapshotsV319Test-1732204612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:37 devstack sudo[85533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741.info
Nov 19 12:53:37 devstack sudo[85533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:37 devstack sudo[85533]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b999c1d0-1587-4d32-ac2d-5f80d31240e9 tempest-GroupSnapshotsV319Test-1732204612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741.info" returned: 0 in 0.615s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b999c1d0-1587-4d32-ac2d-5f80d31240e9 tempest-GroupSnapshotsV319Test-1732204612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.097s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:37 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-b999c1d0-1587-4d32-ac2d-5f80d31240e9 tempest-GroupSnapshotsV319Test-1732204612 None] group_snapshot 7327d8c8-dc17-4d4a-84bd-370faba9728a: created successfully
Nov 19 12:53:39 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-04c1d19f-9eea-4cfc-ac95-69adc8ef2d96 tempest-GroupSnapshotsV319Test-1732204612 None] group_snapshot 7327d8c8-dc17-4d4a-84bd-370faba9728a: deleting
Nov 19 12:53:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-04c1d19f-9eea-4cfc-ac95-69adc8ef2d96 tempest-GroupSnapshotsV319Test-1732204612 None] group_snapshot 7327d8c8-dc17-4d4a-84bd-370faba9728a: deleting {{(pid=80839) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4318}}
Nov 19 12:53:39 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-04c1d19f-9eea-4cfc-ac95-69adc8ef2d96 tempest-GroupSnapshotsV319Test-1732204612 None] Acquiring lock "cinder-quobyte-422662b3-1994-42cc-99b2-d75146c32741" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:53:39 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-04c1d19f-9eea-4cfc-ac95-69adc8ef2d96 tempest-GroupSnapshotsV319Test-1732204612 None] Lock "cinder-quobyte-422662b3-1994-42cc-99b2-d75146c32741" acquired by "delete_snapshot" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:53:39 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-04c1d19f-9eea-4cfc-ac95-69adc8ef2d96 tempest-GroupSnapshotsV319Test-1732204612 None] Acquiring lock "cinder-quobyte-3b26b2f0-6bca-4b75-b4bd-ee64a43bb2a0" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:53:39 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-04c1d19f-9eea-4cfc-ac95-69adc8ef2d96 tempest-GroupSnapshotsV319Test-1732204612 None] Lock "cinder-quobyte-3b26b2f0-6bca-4b75-b4bd-ee64a43bb2a0" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:53:39 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-04c1d19f-9eea-4cfc-ac95-69adc8ef2d96 tempest-GroupSnapshotsV319Test-1732204612 None] Deleting offline snapshot 3b26b2f0-6bca-4b75-b4bd-ee64a43bb2a0 of volume 422662b3-1994-42cc-99b2-d75146c32741 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 12:53:39 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-04c1d19f-9eea-4cfc-ac95-69adc8ef2d96 tempest-GroupSnapshotsV319Test-1732204612 None] snapshot_file for this snap is: volume-422662b3-1994-42cc-99b2-d75146c32741.3b26b2f0-6bca-4b75-b4bd-ee64a43bb2a0 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 12:53:39 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[da60e5da-fef3-48cf-8401-46246c0fb19e]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:53:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-04c1d19f-9eea-4cfc-ac95-69adc8ef2d96 tempest-GroupSnapshotsV319Test-1732204612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741.3b26b2f0-6bca-4b75-b4bd-ee64a43bb2a0 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:39 devstack sudo[85561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741.3b26b2f0-6bca-4b75-b4bd-ee64a43bb2a0
Nov 19 12:53:39 devstack sudo[85561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:40 devstack sudo[85561]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-04c1d19f-9eea-4cfc-ac95-69adc8ef2d96 tempest-GroupSnapshotsV319Test-1732204612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741.3b26b2f0-6bca-4b75-b4bd-ee64a43bb2a0" returned: 0 in 0.669s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:40 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-04c1d19f-9eea-4cfc-ac95-69adc8ef2d96 tempest-GroupSnapshotsV319Test-1732204612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-422662b3-1994-42cc-99b2-d75146c32741(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 12:53:40 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72ee0cd-7015-40d1-98f3-8b87d6aec866]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:53:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-04c1d19f-9eea-4cfc-ac95-69adc8ef2d96 tempest-GroupSnapshotsV319Test-1732204612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:40 devstack sudo[85566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741
Nov 19 12:53:40 devstack sudo[85566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:41 devstack sudo[85566]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-04c1d19f-9eea-4cfc-ac95-69adc8ef2d96 tempest-GroupSnapshotsV319Test-1732204612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741" returned: 0 in 0.805s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-04c1d19f-9eea-4cfc-ac95-69adc8ef2d96 tempest-GroupSnapshotsV319Test-1732204612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741.3b26b2f0-6bca-4b75-b4bd-ee64a43bb2a0 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:41 devstack sudo[85571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741.3b26b2f0-6bca-4b75-b4bd-ee64a43bb2a0
Nov 19 12:53:41 devstack sudo[85571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:41 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:53:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Flow 'volume_create_manager' (c684a0b2-ccff-4270-b041-a93119359b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:53:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061bacd2-6834-48fb-ad71-d72e572fbbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061bacd2-6834-48fb-ad71-d72e572fbbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1239580107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1852d1f9-6022-4da9-aec1-3cc6ec90b974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c80ae67352724208ab2d9e647c1d9f20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:53:42Z,use_quota=True,user_id='9b9192e9cf3d48f9b0fd52b62e08cd57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44a733e-b2d1-452e-9d73-c0e5080297c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44a733e-b2d1-452e-9d73-c0e5080297c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b56df7b-6ea4-45a4-b4f6-c6ed6ebdd681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:41 devstack cinder-volume[80839]: DEBUG cinder.image.glance [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Creating Keystone auth plugin from conf {{(pid=80839) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Nov 19 12:53:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b56df7b-6ea4-45a4-b4f6-c6ed6ebdd681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1852d1f9-6022-4da9-aec1-3cc6ec90b974', 'volume_name': 'volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974', 'volume_size': 1, 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb13a00dd9444268988d63a8279e0575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5d491c17-c417-4a2b-886e-ad2958917626', 'created_at': datetime.datetime(2025, 11, 19, 11, 46, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 19, 11, 46, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d491c17-c417-4a2b-886e-ad2958917626/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbd13da4730>}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e04081-9b50-484f-b0b8-c8036592393e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e04081-9b50-484f-b0b8-c8036592393e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df8a088c-c679-4fb5-aa35-d605cf8cad74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:41 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Volume 1852d1f9-6022-4da9-aec1-3cc6ec90b974: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974', 'volume_size': 1, 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb13a00dd9444268988d63a8279e0575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5d491c17-c417-4a2b-886e-ad2958917626', 'created_at': datetime.datetime(2025, 11, 19, 11, 46, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 19, 11, 46, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d491c17-c417-4a2b-886e-ad2958917626/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbd13da4730>}
Nov 19 12:53:41 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Cloning 1852d1f9-6022-4da9-aec1-3cc6ec90b974 from image 5d491c17-c417-4a2b-886e-ad2958917626  at location (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]). {{(pid=80839) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Nov 19 12:53:42 devstack sudo[85571]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-04c1d19f-9eea-4cfc-ac95-69adc8ef2d96 tempest-GroupSnapshotsV319Test-1732204612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741.3b26b2f0-6bca-4b75-b4bd-ee64a43bb2a0" returned: 0 in 0.987s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-04c1d19f-9eea-4cfc-ac95-69adc8ef2d96 tempest-GroupSnapshotsV319Test-1732204612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741.3b26b2f0-6bca-4b75-b4bd-ee64a43bb2a0 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:42 devstack sudo[85576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741.3b26b2f0-6bca-4b75-b4bd-ee64a43bb2a0
Nov 19 12:53:42 devstack sudo[85576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:42 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_r9vsst_fdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=80839) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Nov 19 12:53:42 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Image download 20.69 MB at 20.69 MB/s
Nov 19 12:53:42 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd7e48f-073d-4a53-8a83-270b444289ae]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:53:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_r9vsst_fdevstack@QuobyteHD {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:42 devstack sudo[85578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_r9vsst_fdevstack@QuobyteHD
Nov 19 12:53:42 devstack sudo[85578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:42 devstack sudo[85576]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-04c1d19f-9eea-4cfc-ac95-69adc8ef2d96 tempest-GroupSnapshotsV319Test-1732204612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741.3b26b2f0-6bca-4b75-b4bd-ee64a43bb2a0" returned: 0 in 0.789s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:42 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-04c1d19f-9eea-4cfc-ac95-69adc8ef2d96 tempest-GroupSnapshotsV319Test-1732204612 None] Lock "cinder-quobyte-3b26b2f0-6bca-4b75-b4bd-ee64a43bb2a0" released by "_delete_snapshot" :: held 3.344s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:53:42 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-04c1d19f-9eea-4cfc-ac95-69adc8ef2d96 tempest-GroupSnapshotsV319Test-1732204612 None] Lock "cinder-quobyte-422662b3-1994-42cc-99b2-d75146c32741" released by "delete_snapshot" :: held 3.362s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:53:42 devstack cinder-volume[80839]: WARNING cinder.quota [None req-04c1d19f-9eea-4cfc-ac95-69adc8ef2d96 tempest-GroupSnapshotsV319Test-1732204612 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1473576758 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1473576758, it is now deprecated. Please use the default quota class for default quota.
Nov 19 12:53:42 devstack cinder-volume[80839]: WARNING cinder.quota [None req-04c1d19f-9eea-4cfc-ac95-69adc8ef2d96 tempest-GroupSnapshotsV319Test-1732204612 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1473576758 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1473576758, it is now deprecated. Please use the default quota class for default quota.
Nov 19 12:53:42 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-04c1d19f-9eea-4cfc-ac95-69adc8ef2d96 tempest-GroupSnapshotsV319Test-1732204612 None] Created reservations ['9c80f050-ed26-4378-85d4-a587f55e4e79', '5a52959f-5476-4f30-8a27-d373c94afa89', 'd9270dd9-9b0e-4838-bbc9-0f419e04eb49', '389e14d6-d9da-4a5c-8865-5c05148eb1d0'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:53:43 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-04c1d19f-9eea-4cfc-ac95-69adc8ef2d96 tempest-GroupSnapshotsV319Test-1732204612 None] group_snapshot 7327d8c8-dc17-4d4a-84bd-370faba9728a: deleted successfully
Nov 19 12:53:43 devstack sudo[85578]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_r9vsst_fdevstack@QuobyteHD" returned: 0 in 0.804s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:43 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Temporary image 5d491c17-c417-4a2b-886e-ad2958917626 is fetched for user 9b9192e9cf3d48f9b0fd52b62e08cd57. {{(pid=80839) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Nov 19 12:53:43 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0810903d-8f93-4a9e-b244-dd71126682f1]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:53:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_r9vsst_fdevstack@QuobyteHD {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:43 devstack sudo[85585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_r9vsst_fdevstack@QuobyteHD
Nov 19 12:53:43 devstack sudo[85585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:43 devstack sudo[85585]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_r9vsst_fdevstack@QuobyteHD" returned: 0 in 0.643s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:43 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1239580107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1852d1f9-6022-4da9-aec1-3cc6ec90b974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c80ae67352724208ab2d9e647c1d9f20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:53:42Z,use_quota=True,user_id='9b9192e9cf3d48f9b0fd52b62e08cd57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:53:43 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Creating volume 1852d1f9-6022-4da9-aec1-3cc6ec90b974 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:53:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:43 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:53:43 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:53:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:43 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:53:43 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:53:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:43 devstack sudo[85590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974 1073741824
Nov 19 12:53:43 devstack sudo[85590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:44 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c6204b6c-c674-43ec-ba6d-a29b0d6838c0 tempest-GroupSnapshotsV319Test-1732204612 None] Acquiring lock "cinder-quobyte-422662b3-1994-42cc-99b2-d75146c32741" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:53:44 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c6204b6c-c674-43ec-ba6d-a29b0d6838c0 tempest-GroupSnapshotsV319Test-1732204612 None] Lock "cinder-quobyte-422662b3-1994-42cc-99b2-d75146c32741" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:53:44 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6180d86-e339-4c73-86cd-bfcd4e118783]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:53:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c6204b6c-c674-43ec-ba6d-a29b0d6838c0 tempest-GroupSnapshotsV319Test-1732204612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:44 devstack sudo[85592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741
Nov 19 12:53:44 devstack sudo[85592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:44 devstack sudo[85590]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974 1073741824" returned: 0 in 0.707s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:44 devstack sudo[85597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974
Nov 19 12:53:44 devstack sudo[85597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:44 devstack sudo[85592]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c6204b6c-c674-43ec-ba6d-a29b0d6838c0 tempest-GroupSnapshotsV319Test-1732204612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741" returned: 0 in 0.785s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c6204b6c-c674-43ec-ba6d-a29b0d6838c0 tempest-GroupSnapshotsV319Test-1732204612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:44 devstack sudo[85602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741
Nov 19 12:53:44 devstack sudo[85602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:45 devstack sudo[85597]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974" returned: 0 in 0.560s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:45 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:53:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:45 devstack cinder-volume[80839]: DEBUG cinder.volume.volume_utils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Attempting download of 5d491c17-c417-4a2b-886e-ad2958917626 ((None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}])) to volume 1852d1f9-6022-4da9-aec1-3cc6ec90b974. {{(pid=80839) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Nov 19 12:53:45 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[244ee28b-83b7-444b-b02f-ee6ce6d5d3c9]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:53:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_6m47ob70 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:45 devstack sudo[85605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_6m47ob70
Nov 19 12:53:45 devstack sudo[85605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:45 devstack sudo[85602]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c6204b6c-c674-43ec-ba6d-a29b0d6838c0 tempest-GroupSnapshotsV319Test-1732204612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-422662b3-1994-42cc-99b2-d75146c32741" returned: 0 in 0.605s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:45 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c6204b6c-c674-43ec-ba6d-a29b0d6838c0 tempest-GroupSnapshotsV319Test-1732204612 None] Lock "cinder-quobyte-422662b3-1994-42cc-99b2-d75146c32741" released by "delete_volume" :: held 1.430s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:53:45 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-c6204b6c-c674-43ec-ba6d-a29b0d6838c0 tempest-GroupSnapshotsV319Test-1732204612 None] Created reservations ['b36340c5-39ed-4590-ab9f-3d5f54cd4d82'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:53:45 devstack cinder-volume[80839]: WARNING cinder.quota [None req-c6204b6c-c674-43ec-ba6d-a29b0d6838c0 tempest-GroupSnapshotsV319Test-1732204612 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1473576758 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1473576758, it is now deprecated. Please use the default quota class for default quota.
Nov 19 12:53:45 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-c6204b6c-c674-43ec-ba6d-a29b0d6838c0 tempest-GroupSnapshotsV319Test-1732204612 None] Created reservations ['007f3ed3-7bb9-4786-a072-4357aca4316f', '77901a51-0291-42c2-a351-0d07263fc7f9', '387b5718-bd83-493b-9f46-15da54820ff1', '884b736e-4a70-4b61-98ef-e36dbdd07276'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:53:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c6204b6c-c674-43ec-ba6d-a29b0d6838c0 tempest-GroupSnapshotsV319Test-1732204612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c6204b6c-c674-43ec-ba6d-a29b0d6838c0 tempest-GroupSnapshotsV319Test-1732204612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:45 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c6204b6c-c674-43ec-ba6d-a29b0d6838c0 tempest-GroupSnapshotsV319Test-1732204612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:53:45 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c6204b6c-c674-43ec-ba6d-a29b0d6838c0 tempest-GroupSnapshotsV319Test-1732204612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:53:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c6204b6c-c674-43ec-ba6d-a29b0d6838c0 tempest-GroupSnapshotsV319Test-1732204612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c6204b6c-c674-43ec-ba6d-a29b0d6838c0 tempest-GroupSnapshotsV319Test-1732204612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:45 devstack sudo[85608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:53:45 devstack sudo[85608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:45 devstack sudo[85605]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_6m47ob70" returned: 0 in 0.775s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_6m47ob70 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:46 devstack sudo[85612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_6m47ob70
Nov 19 12:53:46 devstack sudo[85612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:46 devstack sudo[85608]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c6204b6c-c674-43ec-ba6d-a29b0d6838c0 tempest-GroupSnapshotsV319Test-1732204612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.522s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:46 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-c6204b6c-c674-43ec-ba6d-a29b0d6838c0 tempest-GroupSnapshotsV319Test-1732204612 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:53:46 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-c6204b6c-c674-43ec-ba6d-a29b0d6838c0 tempest-GroupSnapshotsV319Test-1732204612 None] Delete group completed successfully.
Nov 19 12:53:46 devstack sudo[85612]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_6m47ob70" returned: 1 in 0.628s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_6m47ob70' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 12:53:46 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[58db813a-fa85-4e3c-8fcf-c09336d9507b]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:53:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_r9vsst_fdevstack@QuobyteHD {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:46 devstack sudo[85617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_r9vsst_fdevstack@QuobyteHD
Nov 19 12:53:46 devstack sudo[85617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:47 devstack sudo[85617]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_r9vsst_fdevstack@QuobyteHD" returned: 0 in 0.651s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:47 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] 5d491c17-c417-4a2b-886e-ad2958917626 was qcow2, converting to raw {{(pid=80839) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Nov 19 12:53:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_r9vsst_fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:47 devstack sudo[85622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_r9vsst_fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974
Nov 19 12:53:47 devstack sudo[85622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:48 devstack sudo[85622]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_r9vsst_fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974" returned: 0 in 1.270s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:48 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_r9vsst_fdevstack@QuobyteHD, size 112.00 MB, duration 1.27 sec, destination /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974 {{(pid=80839) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 19 12:53:48 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Converted 112.00 MB image at 88.14 MB/s
Nov 19 12:53:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:48 devstack sudo[85630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974 1G
Nov 19 12:53:48 devstack sudo[85630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:49 devstack sudo[85630]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974 1G" returned: 0 in 0.680s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:49 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1665b7-b49c-4f72-9811-5f70f9fcbcc6]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:53:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:49 devstack sudo[85635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974
Nov 19 12:53:49 devstack sudo[85635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:49 devstack sudo[85635]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974" returned: 0 in 0.680s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:49 devstack sudo[85639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974
Nov 19 12:53:49 devstack sudo[85639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:50 devstack sudo[85639]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974" returned: 1 in 0.963s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 12:53:50 devstack cinder-volume[80839]: DEBUG cinder.volume.volume_utils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Downloaded image 5d491c17-c417-4a2b-886e-ad2958917626 ((None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}])) to volume 1852d1f9-6022-4da9-aec1-3cc6ec90b974 successfully. {{(pid=80839) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Nov 19 12:53:50 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Temporary image 5d491c17-c417-4a2b-886e-ad2958917626 for user 9b9192e9cf3d48f9b0fd52b62e08cd57 is deleted. {{(pid=80839) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Nov 19 12:53:50 devstack cinder-volume[80839]: DEBUG cinder.volume.volume_utils [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Marking volume 1852d1f9-6022-4da9-aec1-3cc6ec90b974 as bootable. {{(pid=80839) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Nov 19 12:53:50 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Copying metadata from image 5d491c17-c417-4a2b-886e-ad2958917626 to 1852d1f9-6022-4da9-aec1-3cc6ec90b974. {{(pid=80839) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 19 12:53:50 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Creating volume glance metadata for volume 1852d1f9-6022-4da9-aec1-3cc6ec90b974 backed by image 5d491c17-c417-4a2b-886e-ad2958917626 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=80839) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 19 12:53:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df8a088c-c679-4fb5-aa35-d605cf8cad74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974', 'volume_size': 1, 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb13a00dd9444268988d63a8279e0575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5d491c17-c417-4a2b-886e-ad2958917626', 'created_at': datetime.datetime(2025, 11, 19, 11, 46, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 19, 11, 46, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d491c17-c417-4a2b-886e-ad2958917626/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbd13da4730>}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d677d7-6584-4e94-8e59-6f0d5724f293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:51 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Volume volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974 (1852d1f9-6022-4da9-aec1-3cc6ec90b974): created successfully
Nov 19 12:53:51 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d677d7-6584-4e94-8e59-6f0d5724f293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:51 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Flow 'volume_create_manager' (c684a0b2-ccff-4270-b041-a93119359b50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:53:51 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-827a845e-8685-405b-903f-e04199993b8c tempest-ServerActionsV293TestJSON-1607053477 None] Created volume successfully.
Nov 19 12:53:52 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=123,cinder:DELETE=6,cinder:UPDATE=122,cinder:INSERT=25 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:53:52 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-127415f0-9755-4363-9fec-2d020ca82464 tempest-GroupsV320Test-969850172 None] Group tempest-GroupsV320Test-Group-1394773545: creating
Nov 19 12:53:52 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=98,cinder:UPDATE=102,cinder:DELETE=10,cinder:INSERT=33 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:53:52 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-127415f0-9755-4363-9fec-2d020ca82464 tempest-GroupsV320Test-969850172 None] Group tempest-GroupsV320Test-Group-1394773545: created successfully
Nov 19 12:53:52 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-127415f0-9755-4363-9fec-2d020ca82464 tempest-GroupsV320Test-969850172 None] Create group completed successfully.
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Flow 'volume_create_manager' (e7613841-70ca-4cf2-843e-7e12940c3036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec07d205-307f-4c21-916f-38015c85142e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec07d205-307f-4c21-916f-38015c85142e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1933469455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11dc3473-437c-4ce6-b880-6f27a70a3fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be25a6ac5e644c1a354e9719297a557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:53:53Z,use_quota=True,user_id='76192ad3aa254c3a8aed7f9f5cf24691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471ec9f6-0c17-49cd-a0a6-a3da839e504c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471ec9f6-0c17-49cd-a0a6-a3da839e504c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b4514b-b239-4cb5-a0bc-c6eb57080ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b4514b-b239-4cb5-a0bc-c6eb57080ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11dc3473-437c-4ce6-b880-6f27a70a3fae', 'volume_name': 'volume-11dc3473-437c-4ce6-b880-6f27a70a3fae', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d3dfafd-0f5e-419e-ae8e-ae9f90fada69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d3dfafd-0f5e-419e-ae8e-ae9f90fada69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ca8920-1f03-4d5a-af84-e92996dfc5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:53 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Volume 11dc3473-437c-4ce6-b880-6f27a70a3fae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11dc3473-437c-4ce6-b880-6f27a70a3fae', 'volume_size': 1}
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1933469455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11dc3473-437c-4ce6-b880-6f27a70a3fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be25a6ac5e644c1a354e9719297a557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:53:53Z,use_quota=True,user_id='76192ad3aa254c3a8aed7f9f5cf24691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Creating volume 11dc3473-437c-4ce6-b880-6f27a70a3fae {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:53:53 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-11dc3473-437c-4ce6-b880-6f27a70a3fae 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:53 devstack sudo[85651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-11dc3473-437c-4ce6-b880-6f27a70a3fae 1073741824
Nov 19 12:53:53 devstack sudo[85651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-4e648e5a-6203-4e77-adcf-17ac4b4ceb54 tempest-GroupsV320Test-969850172 None] Created reservations ['1b4d5285-d9eb-4a62-ad78-88706ebd93f7'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4e648e5a-6203-4e77-adcf-17ac4b4ceb54 tempest-GroupsV320Test-969850172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4e648e5a-6203-4e77-adcf-17ac4b4ceb54 tempest-GroupsV320Test-969850172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4e648e5a-6203-4e77-adcf-17ac4b4ceb54 tempest-GroupsV320Test-969850172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4e648e5a-6203-4e77-adcf-17ac4b4ceb54 tempest-GroupsV320Test-969850172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4e648e5a-6203-4e77-adcf-17ac4b4ceb54 tempest-GroupsV320Test-969850172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4e648e5a-6203-4e77-adcf-17ac4b4ceb54 tempest-GroupsV320Test-969850172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:53 devstack sudo[85653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:53:53 devstack sudo[85653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:53 devstack sudo[85651]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-11dc3473-437c-4ce6-b880-6f27a70a3fae 1073741824" returned: 0 in 0.570s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-11dc3473-437c-4ce6-b880-6f27a70a3fae {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:54 devstack sudo[85658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-11dc3473-437c-4ce6-b880-6f27a70a3fae
Nov 19 12:53:54 devstack sudo[85658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:54 devstack sudo[85653]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4e648e5a-6203-4e77-adcf-17ac4b4ceb54 tempest-GroupsV320Test-969850172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.487s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:54 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-4e648e5a-6203-4e77-adcf-17ac4b4ceb54 tempest-GroupsV320Test-969850172 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:53:54 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-4e648e5a-6203-4e77-adcf-17ac4b4ceb54 tempest-GroupsV320Test-969850172 None] Delete group completed successfully.
Nov 19 12:53:54 devstack sudo[85658]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-11dc3473-437c-4ce6-b880-6f27a70a3fae" returned: 0 in 0.453s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:54 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:53:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ca8920-1f03-4d5a-af84-e92996dfc5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11dc3473-437c-4ce6-b880-6f27a70a3fae', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3435d95-cc6c-4bef-ad04-8fc813fd4f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:54 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Volume volume-11dc3473-437c-4ce6-b880-6f27a70a3fae (11dc3473-437c-4ce6-b880-6f27a70a3fae): created successfully
Nov 19 12:53:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3435d95-cc6c-4bef-ad04-8fc813fd4f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Flow 'volume_create_manager' (e7613841-70ca-4cf2-843e-7e12940c3036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:53:54 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-bd59d7a3-5787-4f7d-a05b-481f53ed428d tempest-TaggedAttachmentsTest-362033490 None] Created volume successfully.
Nov 19 12:53:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-0174fa96-0d3f-4441-a5e0-83b6468d3d8c req-fb54ac9e-0a0f-44e6-b9c7-25db8bb11cf2 tempest-ServerActionsV293TestJSON-1607053477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-0174fa96-0d3f-4441-a5e0-83b6468d3d8c req-fb54ac9e-0a0f-44e6-b9c7-25db8bb11cf2 tempest-ServerActionsV293TestJSON-1607053477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:57 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acb82c2-2c09-495f-a23f-9dd10e4cb932]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:53:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-0174fa96-0d3f-4441-a5e0-83b6468d3d8c req-fb54ac9e-0a0f-44e6-b9c7-25db8bb11cf2 tempest-ServerActionsV293TestJSON-1607053477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:57 devstack sudo[85672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974
Nov 19 12:53:57 devstack sudo[85672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:58 devstack sudo[85672]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-0174fa96-0d3f-4441-a5e0-83b6468d3d8c req-fb54ac9e-0a0f-44e6-b9c7-25db8bb11cf2 tempest-ServerActionsV293TestJSON-1607053477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974" returned: 0 in 0.922s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-0174fa96-0d3f-4441-a5e0-83b6468d3d8c req-fb54ac9e-0a0f-44e6-b9c7-25db8bb11cf2 tempest-ServerActionsV293TestJSON-1607053477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:58 devstack sudo[85703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974
Nov 19 12:53:58 devstack sudo[85703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Flow 'volume_create_manager' (7441e438-1823-4521-8eb9-54375282b7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6541cb-e646-45c7-a915-86af3108f6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6541cb-e646-45c7-a915-86af3108f6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-903465049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=568112a2-95f6-42fa-b50b-220c4e6255a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66acfbd617a44b0f856dcb05bbe4acce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:53:59Z,use_quota=True,user_id='946a3bad00874cb986a5edfa8cd22cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1a23156-d792-4557-b0cb-2a469154f051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1a23156-d792-4557-b0cb-2a469154f051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc79866-0993-4097-812c-01449df40aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc79866-0993-4097-812c-01449df40aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '568112a2-95f6-42fa-b50b-220c4e6255a5', 'volume_name': 'volume-568112a2-95f6-42fa-b50b-220c4e6255a5', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4cf0ede-e834-4215-944b-5db8e0d34b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4cf0ede-e834-4215-944b-5db8e0d34b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369c60cf-37f5-4db6-a9c3-2cb70118db83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:53:59 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Volume 568112a2-95f6-42fa-b50b-220c4e6255a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-568112a2-95f6-42fa-b50b-220c4e6255a5', 'volume_size': 1}
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:59 devstack sudo[85703]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-0174fa96-0d3f-4441-a5e0-83b6468d3d8c req-fb54ac9e-0a0f-44e6-b9c7-25db8bb11cf2 tempest-ServerActionsV293TestJSON-1607053477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974" returned: 1 in 0.733s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-0174fa96-0d3f-4441-a5e0-83b6468d3d8c req-fb54ac9e-0a0f-44e6-b9c7-25db8bb11cf2 tempest-ServerActionsV293TestJSON-1607053477 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-0174fa96-0d3f-4441-a5e0-83b6468d3d8c req-fb54ac9e-0a0f-44e6-b9c7-25db8bb11cf2 tempest-ServerActionsV293TestJSON-1607053477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.690s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.132s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-903465049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=568112a2-95f6-42fa-b50b-220c4e6255a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66acfbd617a44b0f856dcb05bbe4acce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:53:59Z,use_quota=True,user_id='946a3bad00874cb986a5edfa8cd22cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Creating volume 568112a2-95f6-42fa-b50b-220c4e6255a5 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:53:59 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:59 devstack sudo[85708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5 1073741824
Nov 19 12:53:59 devstack sudo[85708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-0174fa96-0d3f-4441-a5e0-83b6468d3d8c req-fb54ac9e-0a0f-44e6-b9c7-25db8bb11cf2 tempest-ServerActionsV293TestJSON-1607053477 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cd0e750c-a545-4143-b7e7-d650bb7f668e', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 12:53:59 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-0174fa96-0d3f-4441-a5e0-83b6468d3d8c req-fb54ac9e-0a0f-44e6-b9c7-25db8bb11cf2 tempest-ServerActionsV293TestJSON-1607053477 None] attachment_update completed successfully.
Nov 19 12:53:59 devstack sudo[85708]: pam_unix(sudo:session): session closed for user root
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5 1073741824" returned: 0 in 0.548s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:53:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:53:59 devstack sudo[85713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5
Nov 19 12:53:59 devstack sudo[85713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:00 devstack sudo[85713]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5" returned: 0 in 0.491s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:00 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:54:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:54:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369c60cf-37f5-4db6-a9c3-2cb70118db83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-568112a2-95f6-42fa-b50b-220c4e6255a5', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:54:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61dda04b-5d06-4a39-9d89-a327071e2769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:54:00 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Volume volume-568112a2-95f6-42fa-b50b-220c4e6255a5 (568112a2-95f6-42fa-b50b-220c4e6255a5): created successfully
Nov 19 12:54:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61dda04b-5d06-4a39-9d89-a327071e2769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:54:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Flow 'volume_create_manager' (7441e438-1823-4521-8eb9-54375282b7c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:54:00 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-2477b3c7-abc6-4ffe-8b04-b625ad2260b8 tempest-SnapshotsActionsTest-734248391 None] Created volume successfully.
Nov 19 12:54:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-fdb3d1a1-ffa3-46b6-9c78-514ab19407d8 tempest-SnapshotsActionsTest-734248391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:54:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-fdb3d1a1-ffa3-46b6-9c78-514ab19407d8 tempest-SnapshotsActionsTest-734248391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:54:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-fdb3d1a1-ffa3-46b6-9c78-514ab19407d8 tempest-SnapshotsActionsTest-734248391 None] Creating offline snapshot 271c598e-cb73-4e10-a691-31e98aac4616 of volume 568112a2-95f6-42fa-b50b-220c4e6255a5 {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 12:54:01 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[06786bf6-59cb-4924-9879-cb2f19713021]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:54:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fdb3d1a1-ffa3-46b6-9c78-514ab19407d8 tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:01 devstack sudo[85716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5
Nov 19 12:54:01 devstack sudo[85716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:02 devstack sudo[85716]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fdb3d1a1-ffa3-46b6-9c78-514ab19407d8 tempest-SnapshotsActionsTest-734248391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5" returned: 0 in 0.580s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fdb3d1a1-ffa3-46b6-9c78-514ab19407d8 tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:02 devstack sudo[85721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 1G
Nov 19 12:54:02 devstack sudo[85721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:02 devstack sudo[85721]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fdb3d1a1-ffa3-46b6-9c78-514ab19407d8 tempest-SnapshotsActionsTest-734248391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 1G" returned: 0 in 0.572s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fdb3d1a1-ffa3-46b6-9c78-514ab19407d8 tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568112a2-95f6-42fa-b50b-220c4e6255a5 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:02 devstack sudo[85730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568112a2-95f6-42fa-b50b-220c4e6255a5 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616
Nov 19 12:54:02 devstack sudo[85730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:03 devstack sudo[85730]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fdb3d1a1-ffa3-46b6-9c78-514ab19407d8 tempest-SnapshotsActionsTest-734248391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568112a2-95f6-42fa-b50b-220c4e6255a5 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616" returned: 0 in 0.507s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:03 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-fdb3d1a1-ffa3-46b6-9c78-514ab19407d8 tempest-SnapshotsActionsTest-734248391 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 is being set with open permissions: ugo+rw
Nov 19 12:54:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fdb3d1a1-ffa3-46b6-9c78-514ab19407d8 tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:03 devstack sudo[85735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616
Nov 19 12:54:03 devstack sudo[85735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:03 devstack sudo[85735]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fdb3d1a1-ffa3-46b6-9c78-514ab19407d8 tempest-SnapshotsActionsTest-734248391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616" returned: 0 in 0.470s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fdb3d1a1-ffa3-46b6-9c78-514ab19407d8 tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:03 devstack sudo[85738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.info
Nov 19 12:54:03 devstack sudo[85738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:04 devstack sudo[85738]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fdb3d1a1-ffa3-46b6-9c78-514ab19407d8 tempest-SnapshotsActionsTest-734248391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.info" returned: 0 in 0.804s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:04 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-fdb3d1a1-ffa3-46b6-9c78-514ab19407d8 tempest-SnapshotsActionsTest-734248391 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.info is being set with open permissions: ugo+rw
Nov 19 12:54:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fdb3d1a1-ffa3-46b6-9c78-514ab19407d8 tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 12:54:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:54:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:54:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:54:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:54:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:54:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:04 devstack sudo[85788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.info
Nov 19 12:54:04 devstack sudo[85788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:04 devstack sudo[85791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:54:04 devstack sudo[85791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:05 devstack sudo[85788]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fdb3d1a1-ffa3-46b6-9c78-514ab19407d8 tempest-SnapshotsActionsTest-734248391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.info" returned: 0 in 1.141s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-fdb3d1a1-ffa3-46b6-9c78-514ab19407d8 tempest-SnapshotsActionsTest-734248391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.144s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:54:05 devstack sudo[85791]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:05 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-fdb3d1a1-ffa3-46b6-9c78-514ab19407d8 tempest-SnapshotsActionsTest-734248391 None] Create snapshot completed successfully
Nov 19 12:54:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 1.187s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:05 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:54:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3b183027-9492-4e8d-a0eb-f7ad9504b193 tempest-SnapshotsActionsTest-734248391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:54:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3b183027-9492-4e8d-a0eb-f7ad9504b193 tempest-SnapshotsActionsTest-734248391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:54:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-3b183027-9492-4e8d-a0eb-f7ad9504b193 tempest-SnapshotsActionsTest-734248391 None] Creating offline snapshot e1c682a8-ec49-47e1-a821-2d7aa1dd4f02 of volume 568112a2-95f6-42fa-b50b-220c4e6255a5 {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 12:54:07 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5745bd78-3d47-4b14-b5f6-f414b0e569d0]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:54:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3b183027-9492-4e8d-a0eb-f7ad9504b193 tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:07 devstack sudo[85822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616
Nov 19 12:54:07 devstack sudo[85822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:07 devstack sudo[85822]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3b183027-9492-4e8d-a0eb-f7ad9504b193 tempest-SnapshotsActionsTest-734248391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616" returned: 0 in 0.840s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-3b183027-9492-4e8d-a0eb-f7ad9504b193 tempest-SnapshotsActionsTest-734248391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-568112a2-95f6-42fa-b50b-220c4e6255a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 12:54:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3b183027-9492-4e8d-a0eb-f7ad9504b193 tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.e1c682a8-ec49-47e1-a821-2d7aa1dd4f02 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:07 devstack sudo[85830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.e1c682a8-ec49-47e1-a821-2d7aa1dd4f02 1G
Nov 19 12:54:07 devstack sudo[85830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:08 devstack sudo[85830]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3b183027-9492-4e8d-a0eb-f7ad9504b193 tempest-SnapshotsActionsTest-734248391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.e1c682a8-ec49-47e1-a821-2d7aa1dd4f02 1G" returned: 0 in 0.838s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3b183027-9492-4e8d-a0eb-f7ad9504b193 tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.e1c682a8-ec49-47e1-a821-2d7aa1dd4f02 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:08 devstack sudo[85836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.e1c682a8-ec49-47e1-a821-2d7aa1dd4f02
Nov 19 12:54:08 devstack sudo[85836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:09 devstack sudo[85836]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3b183027-9492-4e8d-a0eb-f7ad9504b193 tempest-SnapshotsActionsTest-734248391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.e1c682a8-ec49-47e1-a821-2d7aa1dd4f02" returned: 0 in 0.576s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:09 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-3b183027-9492-4e8d-a0eb-f7ad9504b193 tempest-SnapshotsActionsTest-734248391 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.e1c682a8-ec49-47e1-a821-2d7aa1dd4f02 is being set with open permissions: ugo+rw
Nov 19 12:54:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3b183027-9492-4e8d-a0eb-f7ad9504b193 tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.e1c682a8-ec49-47e1-a821-2d7aa1dd4f02 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:09 devstack sudo[85842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.e1c682a8-ec49-47e1-a821-2d7aa1dd4f02
Nov 19 12:54:09 devstack sudo[85842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:09 devstack sudo[85842]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3b183027-9492-4e8d-a0eb-f7ad9504b193 tempest-SnapshotsActionsTest-734248391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.e1c682a8-ec49-47e1-a821-2d7aa1dd4f02" returned: 0 in 0.548s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3b183027-9492-4e8d-a0eb-f7ad9504b193 tempest-SnapshotsActionsTest-734248391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.951s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:54:10 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-3b183027-9492-4e8d-a0eb-f7ad9504b193 tempest-SnapshotsActionsTest-734248391 None] Create snapshot completed successfully
Nov 19 12:54:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8a76777e-8e43-48d9-b34e-8f11ac9cdd44 tempest-SnapshotsActionsTest-1061400600 None] Acquiring lock "cinder-e1c682a8-ec49-47e1-a821-2d7aa1dd4f02-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:54:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8a76777e-8e43-48d9-b34e-8f11ac9cdd44 tempest-SnapshotsActionsTest-1061400600 None] Lock "cinder-e1c682a8-ec49-47e1-a821-2d7aa1dd4f02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:54:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8a76777e-8e43-48d9-b34e-8f11ac9cdd44 tempest-SnapshotsActionsTest-1061400600 None] Acquiring lock "cinder-quobyte-568112a2-95f6-42fa-b50b-220c4e6255a5" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:54:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8a76777e-8e43-48d9-b34e-8f11ac9cdd44 tempest-SnapshotsActionsTest-1061400600 None] Lock "cinder-quobyte-568112a2-95f6-42fa-b50b-220c4e6255a5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:54:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8a76777e-8e43-48d9-b34e-8f11ac9cdd44 tempest-SnapshotsActionsTest-1061400600 None] Acquiring lock "cinder-quobyte-e1c682a8-ec49-47e1-a821-2d7aa1dd4f02" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:54:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8a76777e-8e43-48d9-b34e-8f11ac9cdd44 tempest-SnapshotsActionsTest-1061400600 None] Lock "cinder-quobyte-e1c682a8-ec49-47e1-a821-2d7aa1dd4f02" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:54:10 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-8a76777e-8e43-48d9-b34e-8f11ac9cdd44 tempest-SnapshotsActionsTest-1061400600 None] Deleting offline snapshot e1c682a8-ec49-47e1-a821-2d7aa1dd4f02 of volume 568112a2-95f6-42fa-b50b-220c4e6255a5 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 12:54:10 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-8a76777e-8e43-48d9-b34e-8f11ac9cdd44 tempest-SnapshotsActionsTest-1061400600 None] snapshot_file for this snap is: volume-568112a2-95f6-42fa-b50b-220c4e6255a5.e1c682a8-ec49-47e1-a821-2d7aa1dd4f02 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 12:54:10 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa68043-1b57-473b-9662-056c3e99b6c8]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:54:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8a76777e-8e43-48d9-b34e-8f11ac9cdd44 tempest-SnapshotsActionsTest-1061400600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.e1c682a8-ec49-47e1-a821-2d7aa1dd4f02 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:11 devstack sudo[85900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.e1c682a8-ec49-47e1-a821-2d7aa1dd4f02
Nov 19 12:54:11 devstack sudo[85900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:11 devstack sudo[85900]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8a76777e-8e43-48d9-b34e-8f11ac9cdd44 tempest-SnapshotsActionsTest-1061400600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.e1c682a8-ec49-47e1-a821-2d7aa1dd4f02" returned: 0 in 0.927s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:11 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-8a76777e-8e43-48d9-b34e-8f11ac9cdd44 tempest-SnapshotsActionsTest-1061400600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-568112a2-95f6-42fa-b50b-220c4e6255a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 12:54:11 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[80af66c4-2b0d-4918-a11b-3504529681e0]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:54:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8a76777e-8e43-48d9-b34e-8f11ac9cdd44 tempest-SnapshotsActionsTest-1061400600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:11 devstack sudo[85912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616
Nov 19 12:54:11 devstack sudo[85912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:12 devstack sudo[85912]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8a76777e-8e43-48d9-b34e-8f11ac9cdd44 tempest-SnapshotsActionsTest-1061400600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616" returned: 0 in 0.648s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-8a76777e-8e43-48d9-b34e-8f11ac9cdd44 tempest-SnapshotsActionsTest-1061400600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-568112a2-95f6-42fa-b50b-220c4e6255a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 12:54:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8a76777e-8e43-48d9-b34e-8f11ac9cdd44 tempest-SnapshotsActionsTest-1061400600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.e1c682a8-ec49-47e1-a821-2d7aa1dd4f02 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:12 devstack sudo[85917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.e1c682a8-ec49-47e1-a821-2d7aa1dd4f02
Nov 19 12:54:12 devstack sudo[85917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:13 devstack sudo[85917]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8a76777e-8e43-48d9-b34e-8f11ac9cdd44 tempest-SnapshotsActionsTest-1061400600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.e1c682a8-ec49-47e1-a821-2d7aa1dd4f02" returned: 0 in 0.856s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8a76777e-8e43-48d9-b34e-8f11ac9cdd44 tempest-SnapshotsActionsTest-1061400600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.e1c682a8-ec49-47e1-a821-2d7aa1dd4f02 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:13 devstack sudo[85923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.e1c682a8-ec49-47e1-a821-2d7aa1dd4f02
Nov 19 12:54:13 devstack sudo[85923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:13 devstack sudo[85923]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8a76777e-8e43-48d9-b34e-8f11ac9cdd44 tempest-SnapshotsActionsTest-1061400600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.e1c682a8-ec49-47e1-a821-2d7aa1dd4f02" returned: 0 in 0.625s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:13 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8a76777e-8e43-48d9-b34e-8f11ac9cdd44 tempest-SnapshotsActionsTest-1061400600 None] Lock "cinder-quobyte-e1c682a8-ec49-47e1-a821-2d7aa1dd4f02" released by "_delete_snapshot" :: held 3.163s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:54:13 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8a76777e-8e43-48d9-b34e-8f11ac9cdd44 tempest-SnapshotsActionsTest-1061400600 None] Lock "cinder-quobyte-568112a2-95f6-42fa-b50b-220c4e6255a5" released by "delete_snapshot" :: held 3.192s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:54:13 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-8a76777e-8e43-48d9-b34e-8f11ac9cdd44 tempest-SnapshotsActionsTest-1061400600 None] Created reservations ['d3d45f29-786a-445a-8993-0865576e74da', '73da5af2-c7dc-4e48-95c1-2fb83ad3e606', 'e90a2879-a052-426b-9d3a-03d55d733427', '3a9f656b-5054-4785-96d9-5182a623fda6'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:54:13 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-8a76777e-8e43-48d9-b34e-8f11ac9cdd44 tempest-SnapshotsActionsTest-1061400600 None] Delete snapshot completed successfully.
Nov 19 12:54:13 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8a76777e-8e43-48d9-b34e-8f11ac9cdd44 tempest-SnapshotsActionsTest-1061400600 None] Lock "cinder-e1c682a8-ec49-47e1-a821-2d7aa1dd4f02-delete_snapshot" released by "delete_snapshot" :: held 3.376s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:54:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-49472478-b914-4764-b773-8cfef7a2fe05 tempest-SnapshotsActionsTest-734248391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:54:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-49472478-b914-4764-b773-8cfef7a2fe05 tempest-SnapshotsActionsTest-734248391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:54:15 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-49472478-b914-4764-b773-8cfef7a2fe05 tempest-SnapshotsActionsTest-734248391 None] Creating offline snapshot 21d70e24-45da-4190-a8c6-405d4567ac5c of volume 568112a2-95f6-42fa-b50b-220c4e6255a5 {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 12:54:15 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a756591f-5123-41ed-a833-fe7a9826ad66]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:54:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-49472478-b914-4764-b773-8cfef7a2fe05 tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:15 devstack sudo[85928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616
Nov 19 12:54:15 devstack sudo[85928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:15 devstack sudo[85928]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-49472478-b914-4764-b773-8cfef7a2fe05 tempest-SnapshotsActionsTest-734248391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616" returned: 0 in 0.610s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:15 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-49472478-b914-4764-b773-8cfef7a2fe05 tempest-SnapshotsActionsTest-734248391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-568112a2-95f6-42fa-b50b-220c4e6255a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 12:54:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-49472478-b914-4764-b773-8cfef7a2fe05 tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.21d70e24-45da-4190-a8c6-405d4567ac5c 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:15 devstack sudo[85933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.21d70e24-45da-4190-a8c6-405d4567ac5c 1G
Nov 19 12:54:15 devstack sudo[85933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:16 devstack sudo[85933]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-49472478-b914-4764-b773-8cfef7a2fe05 tempest-SnapshotsActionsTest-734248391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.21d70e24-45da-4190-a8c6-405d4567ac5c 1G" returned: 0 in 0.584s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-49472478-b914-4764-b773-8cfef7a2fe05 tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.21d70e24-45da-4190-a8c6-405d4567ac5c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:16 devstack sudo[85938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.21d70e24-45da-4190-a8c6-405d4567ac5c
Nov 19 12:54:16 devstack sudo[85938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:16 devstack sudo[85938]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-49472478-b914-4764-b773-8cfef7a2fe05 tempest-SnapshotsActionsTest-734248391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.21d70e24-45da-4190-a8c6-405d4567ac5c" returned: 0 in 0.488s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:16 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-49472478-b914-4764-b773-8cfef7a2fe05 tempest-SnapshotsActionsTest-734248391 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.21d70e24-45da-4190-a8c6-405d4567ac5c is being set with open permissions: ugo+rw
Nov 19 12:54:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-49472478-b914-4764-b773-8cfef7a2fe05 tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.21d70e24-45da-4190-a8c6-405d4567ac5c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:16 devstack sudo[85943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.21d70e24-45da-4190-a8c6-405d4567ac5c
Nov 19 12:54:16 devstack sudo[85943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:17 devstack sudo[85943]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-49472478-b914-4764-b773-8cfef7a2fe05 tempest-SnapshotsActionsTest-734248391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.21d70e24-45da-4190-a8c6-405d4567ac5c" returned: 0 in 0.444s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-49472478-b914-4764-b773-8cfef7a2fe05 tempest-SnapshotsActionsTest-734248391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.180s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:54:17 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-49472478-b914-4764-b773-8cfef7a2fe05 tempest-SnapshotsActionsTest-734248391 None] Create snapshot completed successfully
Nov 19 12:54:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a3f5cc08-0355-43f7-a1b7-14ef6e0b1780 tempest-SnapshotsActionsTest-1061400600 None] Acquiring lock "cinder-21d70e24-45da-4190-a8c6-405d4567ac5c-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:54:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a3f5cc08-0355-43f7-a1b7-14ef6e0b1780 tempest-SnapshotsActionsTest-1061400600 None] Lock "cinder-21d70e24-45da-4190-a8c6-405d4567ac5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:54:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a3f5cc08-0355-43f7-a1b7-14ef6e0b1780 tempest-SnapshotsActionsTest-1061400600 None] Acquiring lock "cinder-quobyte-568112a2-95f6-42fa-b50b-220c4e6255a5" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:54:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a3f5cc08-0355-43f7-a1b7-14ef6e0b1780 tempest-SnapshotsActionsTest-1061400600 None] Lock "cinder-quobyte-568112a2-95f6-42fa-b50b-220c4e6255a5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:54:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a3f5cc08-0355-43f7-a1b7-14ef6e0b1780 tempest-SnapshotsActionsTest-1061400600 None] Acquiring lock "cinder-quobyte-21d70e24-45da-4190-a8c6-405d4567ac5c" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:54:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a3f5cc08-0355-43f7-a1b7-14ef6e0b1780 tempest-SnapshotsActionsTest-1061400600 None] Lock "cinder-quobyte-21d70e24-45da-4190-a8c6-405d4567ac5c" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:54:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-a3f5cc08-0355-43f7-a1b7-14ef6e0b1780 tempest-SnapshotsActionsTest-1061400600 None] Deleting offline snapshot 21d70e24-45da-4190-a8c6-405d4567ac5c of volume 568112a2-95f6-42fa-b50b-220c4e6255a5 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 12:54:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-a3f5cc08-0355-43f7-a1b7-14ef6e0b1780 tempest-SnapshotsActionsTest-1061400600 None] snapshot_file for this snap is: volume-568112a2-95f6-42fa-b50b-220c4e6255a5.21d70e24-45da-4190-a8c6-405d4567ac5c {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 12:54:18 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4310949-cad7-46cb-bbf4-5b1ab9b00f9f]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:54:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a3f5cc08-0355-43f7-a1b7-14ef6e0b1780 tempest-SnapshotsActionsTest-1061400600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.21d70e24-45da-4190-a8c6-405d4567ac5c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:18 devstack sudo[85946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.21d70e24-45da-4190-a8c6-405d4567ac5c
Nov 19 12:54:18 devstack sudo[85946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:18 devstack sudo[85946]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a3f5cc08-0355-43f7-a1b7-14ef6e0b1780 tempest-SnapshotsActionsTest-1061400600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.21d70e24-45da-4190-a8c6-405d4567ac5c" returned: 0 in 0.570s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-a3f5cc08-0355-43f7-a1b7-14ef6e0b1780 tempest-SnapshotsActionsTest-1061400600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-568112a2-95f6-42fa-b50b-220c4e6255a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 12:54:18 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[148630ca-2d6f-4c1a-9ba6-8ca753af8061]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:54:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a3f5cc08-0355-43f7-a1b7-14ef6e0b1780 tempest-SnapshotsActionsTest-1061400600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:19 devstack sudo[85951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616
Nov 19 12:54:19 devstack sudo[85951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:19 devstack sudo[85951]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a3f5cc08-0355-43f7-a1b7-14ef6e0b1780 tempest-SnapshotsActionsTest-1061400600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616" returned: 0 in 0.570s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:19 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-a3f5cc08-0355-43f7-a1b7-14ef6e0b1780 tempest-SnapshotsActionsTest-1061400600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-568112a2-95f6-42fa-b50b-220c4e6255a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 12:54:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a3f5cc08-0355-43f7-a1b7-14ef6e0b1780 tempest-SnapshotsActionsTest-1061400600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.21d70e24-45da-4190-a8c6-405d4567ac5c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:19 devstack sudo[85956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.21d70e24-45da-4190-a8c6-405d4567ac5c
Nov 19 12:54:19 devstack sudo[85956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:19 devstack sudo[85956]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a3f5cc08-0355-43f7-a1b7-14ef6e0b1780 tempest-SnapshotsActionsTest-1061400600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.21d70e24-45da-4190-a8c6-405d4567ac5c" returned: 0 in 0.499s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a3f5cc08-0355-43f7-a1b7-14ef6e0b1780 tempest-SnapshotsActionsTest-1061400600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.21d70e24-45da-4190-a8c6-405d4567ac5c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:20 devstack sudo[85961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.21d70e24-45da-4190-a8c6-405d4567ac5c
Nov 19 12:54:20 devstack sudo[85961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:20 devstack sudo[85961]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a3f5cc08-0355-43f7-a1b7-14ef6e0b1780 tempest-SnapshotsActionsTest-1061400600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.21d70e24-45da-4190-a8c6-405d4567ac5c" returned: 0 in 0.472s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a3f5cc08-0355-43f7-a1b7-14ef6e0b1780 tempest-SnapshotsActionsTest-1061400600 None] Lock "cinder-quobyte-21d70e24-45da-4190-a8c6-405d4567ac5c" released by "_delete_snapshot" :: held 2.191s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:54:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a3f5cc08-0355-43f7-a1b7-14ef6e0b1780 tempest-SnapshotsActionsTest-1061400600 None] Lock "cinder-quobyte-568112a2-95f6-42fa-b50b-220c4e6255a5" released by "delete_snapshot" :: held 2.204s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:54:20 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-a3f5cc08-0355-43f7-a1b7-14ef6e0b1780 tempest-SnapshotsActionsTest-1061400600 None] Created reservations ['006e6d3e-0b41-4016-8fd9-cbd3c0f5ab6e', '5aa73d9f-0537-4a2f-ab74-fada9715a4c9', '03c86066-344d-4fe0-9142-f92ac90fc053', '7b661f3a-823c-40b1-8c44-03e0070c1aaa'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:54:20 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-a3f5cc08-0355-43f7-a1b7-14ef6e0b1780 tempest-SnapshotsActionsTest-1061400600 None] Delete snapshot completed successfully.
Nov 19 12:54:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a3f5cc08-0355-43f7-a1b7-14ef6e0b1780 tempest-SnapshotsActionsTest-1061400600 None] Lock "cinder-21d70e24-45da-4190-a8c6-405d4567ac5c-delete_snapshot" released by "delete_snapshot" :: held 2.320s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:54:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-249a663e-8222-49a3-aec4-db2d3896fc5a tempest-SnapshotsActionsTest-734248391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:54:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-249a663e-8222-49a3-aec4-db2d3896fc5a tempest-SnapshotsActionsTest-734248391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:54:21 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-249a663e-8222-49a3-aec4-db2d3896fc5a tempest-SnapshotsActionsTest-734248391 None] Creating offline snapshot c10a45c8-9190-4222-803d-525c7f42357e of volume 568112a2-95f6-42fa-b50b-220c4e6255a5 {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 12:54:21 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a76b1d9-a816-48f5-a4d7-1887dd305b96]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:54:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-249a663e-8222-49a3-aec4-db2d3896fc5a tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:21 devstack sudo[85964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616
Nov 19 12:54:21 devstack sudo[85964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:22 devstack sudo[85964]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-249a663e-8222-49a3-aec4-db2d3896fc5a tempest-SnapshotsActionsTest-734248391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616" returned: 0 in 0.597s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:22 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-249a663e-8222-49a3-aec4-db2d3896fc5a tempest-SnapshotsActionsTest-734248391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-568112a2-95f6-42fa-b50b-220c4e6255a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 12:54:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-249a663e-8222-49a3-aec4-db2d3896fc5a tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.c10a45c8-9190-4222-803d-525c7f42357e 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:22 devstack sudo[85969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.c10a45c8-9190-4222-803d-525c7f42357e 1G
Nov 19 12:54:22 devstack sudo[85969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:22 devstack sudo[85969]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-249a663e-8222-49a3-aec4-db2d3896fc5a tempest-SnapshotsActionsTest-734248391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.c10a45c8-9190-4222-803d-525c7f42357e 1G" returned: 0 in 0.570s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-249a663e-8222-49a3-aec4-db2d3896fc5a tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.c10a45c8-9190-4222-803d-525c7f42357e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:22 devstack sudo[85975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.c10a45c8-9190-4222-803d-525c7f42357e
Nov 19 12:54:22 devstack sudo[85975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:23 devstack sudo[85975]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-249a663e-8222-49a3-aec4-db2d3896fc5a tempest-SnapshotsActionsTest-734248391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.c10a45c8-9190-4222-803d-525c7f42357e" returned: 0 in 0.486s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:23 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-249a663e-8222-49a3-aec4-db2d3896fc5a tempest-SnapshotsActionsTest-734248391 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.c10a45c8-9190-4222-803d-525c7f42357e is being set with open permissions: ugo+rw
Nov 19 12:54:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-249a663e-8222-49a3-aec4-db2d3896fc5a tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.c10a45c8-9190-4222-803d-525c7f42357e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:23 devstack sudo[85980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.c10a45c8-9190-4222-803d-525c7f42357e
Nov 19 12:54:23 devstack sudo[85980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:23 devstack sudo[85980]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-249a663e-8222-49a3-aec4-db2d3896fc5a tempest-SnapshotsActionsTest-734248391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.c10a45c8-9190-4222-803d-525c7f42357e" returned: 0 in 0.463s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-249a663e-8222-49a3-aec4-db2d3896fc5a tempest-SnapshotsActionsTest-734248391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.183s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:54:23 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-249a663e-8222-49a3-aec4-db2d3896fc5a tempest-SnapshotsActionsTest-734248391 None] Create snapshot completed successfully
Nov 19 12:54:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d2007a26-0537-4afc-ae72-2dacdf16ed6f tempest-SnapshotsActionsTest-1061400600 None] Acquiring lock "cinder-c10a45c8-9190-4222-803d-525c7f42357e-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:54:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d2007a26-0537-4afc-ae72-2dacdf16ed6f tempest-SnapshotsActionsTest-1061400600 None] Lock "cinder-c10a45c8-9190-4222-803d-525c7f42357e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:54:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d2007a26-0537-4afc-ae72-2dacdf16ed6f tempest-SnapshotsActionsTest-1061400600 None] Acquiring lock "cinder-quobyte-568112a2-95f6-42fa-b50b-220c4e6255a5" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:54:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d2007a26-0537-4afc-ae72-2dacdf16ed6f tempest-SnapshotsActionsTest-1061400600 None] Lock "cinder-quobyte-568112a2-95f6-42fa-b50b-220c4e6255a5" acquired by "delete_snapshot" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:54:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d2007a26-0537-4afc-ae72-2dacdf16ed6f tempest-SnapshotsActionsTest-1061400600 None] Acquiring lock "cinder-quobyte-c10a45c8-9190-4222-803d-525c7f42357e" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:54:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d2007a26-0537-4afc-ae72-2dacdf16ed6f tempest-SnapshotsActionsTest-1061400600 None] Lock "cinder-quobyte-c10a45c8-9190-4222-803d-525c7f42357e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:54:24 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-d2007a26-0537-4afc-ae72-2dacdf16ed6f tempest-SnapshotsActionsTest-1061400600 None] Deleting offline snapshot c10a45c8-9190-4222-803d-525c7f42357e of volume 568112a2-95f6-42fa-b50b-220c4e6255a5 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 12:54:24 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-d2007a26-0537-4afc-ae72-2dacdf16ed6f tempest-SnapshotsActionsTest-1061400600 None] snapshot_file for this snap is: volume-568112a2-95f6-42fa-b50b-220c4e6255a5.c10a45c8-9190-4222-803d-525c7f42357e {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 12:54:24 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd13b88b-02c8-41e9-8eb4-9e92d4b4e9d2]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:54:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d2007a26-0537-4afc-ae72-2dacdf16ed6f tempest-SnapshotsActionsTest-1061400600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.c10a45c8-9190-4222-803d-525c7f42357e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:25 devstack sudo[85990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.c10a45c8-9190-4222-803d-525c7f42357e
Nov 19 12:54:25 devstack sudo[85990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:25 devstack sudo[85990]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d2007a26-0537-4afc-ae72-2dacdf16ed6f tempest-SnapshotsActionsTest-1061400600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.c10a45c8-9190-4222-803d-525c7f42357e" returned: 0 in 0.725s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:25 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-d2007a26-0537-4afc-ae72-2dacdf16ed6f tempest-SnapshotsActionsTest-1061400600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-568112a2-95f6-42fa-b50b-220c4e6255a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 12:54:25 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2ba616-45ff-4c12-8c13-97c582588a4c]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:54:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d2007a26-0537-4afc-ae72-2dacdf16ed6f tempest-SnapshotsActionsTest-1061400600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:25 devstack sudo[85995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616
Nov 19 12:54:25 devstack sudo[85995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:26 devstack sudo[85995]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d2007a26-0537-4afc-ae72-2dacdf16ed6f tempest-SnapshotsActionsTest-1061400600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616" returned: 0 in 0.656s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-d2007a26-0537-4afc-ae72-2dacdf16ed6f tempest-SnapshotsActionsTest-1061400600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-568112a2-95f6-42fa-b50b-220c4e6255a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 12:54:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d2007a26-0537-4afc-ae72-2dacdf16ed6f tempest-SnapshotsActionsTest-1061400600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.c10a45c8-9190-4222-803d-525c7f42357e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:26 devstack sudo[86000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.c10a45c8-9190-4222-803d-525c7f42357e
Nov 19 12:54:26 devstack sudo[86000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:26 devstack sudo[86000]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d2007a26-0537-4afc-ae72-2dacdf16ed6f tempest-SnapshotsActionsTest-1061400600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.c10a45c8-9190-4222-803d-525c7f42357e" returned: 0 in 0.531s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d2007a26-0537-4afc-ae72-2dacdf16ed6f tempest-SnapshotsActionsTest-1061400600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.c10a45c8-9190-4222-803d-525c7f42357e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:26 devstack sudo[86005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.c10a45c8-9190-4222-803d-525c7f42357e
Nov 19 12:54:26 devstack sudo[86005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:27 devstack sudo[86005]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d2007a26-0537-4afc-ae72-2dacdf16ed6f tempest-SnapshotsActionsTest-1061400600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.c10a45c8-9190-4222-803d-525c7f42357e" returned: 0 in 0.477s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:27 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d2007a26-0537-4afc-ae72-2dacdf16ed6f tempest-SnapshotsActionsTest-1061400600 None] Lock "cinder-quobyte-c10a45c8-9190-4222-803d-525c7f42357e" released by "_delete_snapshot" :: held 2.472s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:54:27 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d2007a26-0537-4afc-ae72-2dacdf16ed6f tempest-SnapshotsActionsTest-1061400600 None] Lock "cinder-quobyte-568112a2-95f6-42fa-b50b-220c4e6255a5" released by "delete_snapshot" :: held 2.492s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:54:27 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-d2007a26-0537-4afc-ae72-2dacdf16ed6f tempest-SnapshotsActionsTest-1061400600 None] Created reservations ['e35a9152-8eac-4489-9878-a4720677d482', 'b2892e52-d452-4791-a8bf-9c022a5357ce', '9a45bd78-ea62-4cf8-bffc-02794954ec96', 'a7431a45-a61a-4424-8693-922aeb58462e'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:54:27 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-d2007a26-0537-4afc-ae72-2dacdf16ed6f tempest-SnapshotsActionsTest-1061400600 None] Delete snapshot completed successfully.
Nov 19 12:54:27 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d2007a26-0537-4afc-ae72-2dacdf16ed6f tempest-SnapshotsActionsTest-1061400600 None] Lock "cinder-c10a45c8-9190-4222-803d-525c7f42357e-delete_snapshot" released by "delete_snapshot" :: held 2.579s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:54:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7ede5f07-a552-4a44-869d-aeb79dc334d1 tempest-SnapshotsActionsTest-734248391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:54:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7ede5f07-a552-4a44-869d-aeb79dc334d1 tempest-SnapshotsActionsTest-734248391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:54:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-7ede5f07-a552-4a44-869d-aeb79dc334d1 tempest-SnapshotsActionsTest-734248391 None] Creating offline snapshot 750dd672-f2aa-4ec2-98f4-13c39a4f11cf of volume 568112a2-95f6-42fa-b50b-220c4e6255a5 {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 12:54:28 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[14429ed4-7147-4ca5-aa2f-4d80c40b0aad]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:54:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7ede5f07-a552-4a44-869d-aeb79dc334d1 tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:28 devstack sudo[86009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616
Nov 19 12:54:28 devstack sudo[86009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:28 devstack sudo[86009]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7ede5f07-a552-4a44-869d-aeb79dc334d1 tempest-SnapshotsActionsTest-734248391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616" returned: 0 in 0.533s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-7ede5f07-a552-4a44-869d-aeb79dc334d1 tempest-SnapshotsActionsTest-734248391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-568112a2-95f6-42fa-b50b-220c4e6255a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 12:54:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7ede5f07-a552-4a44-869d-aeb79dc334d1 tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.750dd672-f2aa-4ec2-98f4-13c39a4f11cf 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:28 devstack sudo[86014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.750dd672-f2aa-4ec2-98f4-13c39a4f11cf 1G
Nov 19 12:54:28 devstack sudo[86014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:29 devstack sudo[86014]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7ede5f07-a552-4a44-869d-aeb79dc334d1 tempest-SnapshotsActionsTest-734248391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.750dd672-f2aa-4ec2-98f4-13c39a4f11cf 1G" returned: 0 in 0.649s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7ede5f07-a552-4a44-869d-aeb79dc334d1 tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.750dd672-f2aa-4ec2-98f4-13c39a4f11cf {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:29 devstack sudo[86053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.750dd672-f2aa-4ec2-98f4-13c39a4f11cf
Nov 19 12:54:29 devstack sudo[86053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:29 devstack sudo[86053]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7ede5f07-a552-4a44-869d-aeb79dc334d1 tempest-SnapshotsActionsTest-734248391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.750dd672-f2aa-4ec2-98f4-13c39a4f11cf" returned: 0 in 0.474s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:29 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-7ede5f07-a552-4a44-869d-aeb79dc334d1 tempest-SnapshotsActionsTest-734248391 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.750dd672-f2aa-4ec2-98f4-13c39a4f11cf is being set with open permissions: ugo+rw
Nov 19 12:54:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7ede5f07-a552-4a44-869d-aeb79dc334d1 tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.750dd672-f2aa-4ec2-98f4-13c39a4f11cf {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:30 devstack sudo[86059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.750dd672-f2aa-4ec2-98f4-13c39a4f11cf
Nov 19 12:54:30 devstack sudo[86059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:30 devstack sudo[86059]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7ede5f07-a552-4a44-869d-aeb79dc334d1 tempest-SnapshotsActionsTest-734248391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.750dd672-f2aa-4ec2-98f4-13c39a4f11cf" returned: 0 in 0.456s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7ede5f07-a552-4a44-869d-aeb79dc334d1 tempest-SnapshotsActionsTest-734248391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.169s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:54:30 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-7ede5f07-a552-4a44-869d-aeb79dc334d1 tempest-SnapshotsActionsTest-734248391 None] Create snapshot completed successfully
Nov 19 12:54:31 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-64df5a5d-a909-4e56-8472-1c536c1467f6 tempest-SnapshotsActionsTest-1061400600 None] Acquiring lock "cinder-750dd672-f2aa-4ec2-98f4-13c39a4f11cf-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:54:31 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-64df5a5d-a909-4e56-8472-1c536c1467f6 tempest-SnapshotsActionsTest-1061400600 None] Lock "cinder-750dd672-f2aa-4ec2-98f4-13c39a4f11cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:54:31 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-64df5a5d-a909-4e56-8472-1c536c1467f6 tempest-SnapshotsActionsTest-1061400600 None] Acquiring lock "cinder-quobyte-568112a2-95f6-42fa-b50b-220c4e6255a5" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:54:31 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-64df5a5d-a909-4e56-8472-1c536c1467f6 tempest-SnapshotsActionsTest-1061400600 None] Lock "cinder-quobyte-568112a2-95f6-42fa-b50b-220c4e6255a5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:54:31 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-64df5a5d-a909-4e56-8472-1c536c1467f6 tempest-SnapshotsActionsTest-1061400600 None] Acquiring lock "cinder-quobyte-750dd672-f2aa-4ec2-98f4-13c39a4f11cf" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:54:31 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-64df5a5d-a909-4e56-8472-1c536c1467f6 tempest-SnapshotsActionsTest-1061400600 None] Lock "cinder-quobyte-750dd672-f2aa-4ec2-98f4-13c39a4f11cf" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:54:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-64df5a5d-a909-4e56-8472-1c536c1467f6 tempest-SnapshotsActionsTest-1061400600 None] Deleting offline snapshot 750dd672-f2aa-4ec2-98f4-13c39a4f11cf of volume 568112a2-95f6-42fa-b50b-220c4e6255a5 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 12:54:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-64df5a5d-a909-4e56-8472-1c536c1467f6 tempest-SnapshotsActionsTest-1061400600 None] snapshot_file for this snap is: volume-568112a2-95f6-42fa-b50b-220c4e6255a5.750dd672-f2aa-4ec2-98f4-13c39a4f11cf {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 12:54:31 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a108b65-8f25-4f32-b20b-96f39468b231]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:54:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-64df5a5d-a909-4e56-8472-1c536c1467f6 tempest-SnapshotsActionsTest-1061400600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.750dd672-f2aa-4ec2-98f4-13c39a4f11cf {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:31 devstack sudo[86062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.750dd672-f2aa-4ec2-98f4-13c39a4f11cf
Nov 19 12:54:31 devstack sudo[86062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:32 devstack sudo[86062]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-64df5a5d-a909-4e56-8472-1c536c1467f6 tempest-SnapshotsActionsTest-1061400600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.750dd672-f2aa-4ec2-98f4-13c39a4f11cf" returned: 0 in 0.561s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:32 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-64df5a5d-a909-4e56-8472-1c536c1467f6 tempest-SnapshotsActionsTest-1061400600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-568112a2-95f6-42fa-b50b-220c4e6255a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 12:54:32 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc337cc-7239-48fe-803a-ae905f438829]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:54:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-64df5a5d-a909-4e56-8472-1c536c1467f6 tempest-SnapshotsActionsTest-1061400600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:32 devstack sudo[86067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616
Nov 19 12:54:32 devstack sudo[86067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:32 devstack sudo[86067]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-64df5a5d-a909-4e56-8472-1c536c1467f6 tempest-SnapshotsActionsTest-1061400600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616" returned: 0 in 0.617s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:32 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-64df5a5d-a909-4e56-8472-1c536c1467f6 tempest-SnapshotsActionsTest-1061400600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-568112a2-95f6-42fa-b50b-220c4e6255a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 12:54:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-64df5a5d-a909-4e56-8472-1c536c1467f6 tempest-SnapshotsActionsTest-1061400600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.750dd672-f2aa-4ec2-98f4-13c39a4f11cf {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:32 devstack sudo[86074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.750dd672-f2aa-4ec2-98f4-13c39a4f11cf
Nov 19 12:54:32 devstack sudo[86074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:33 devstack sudo[86074]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-64df5a5d-a909-4e56-8472-1c536c1467f6 tempest-SnapshotsActionsTest-1061400600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.750dd672-f2aa-4ec2-98f4-13c39a4f11cf" returned: 0 in 0.514s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-64df5a5d-a909-4e56-8472-1c536c1467f6 tempest-SnapshotsActionsTest-1061400600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.750dd672-f2aa-4ec2-98f4-13c39a4f11cf {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:33 devstack sudo[86079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.750dd672-f2aa-4ec2-98f4-13c39a4f11cf
Nov 19 12:54:33 devstack sudo[86079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:33 devstack sudo[86079]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-64df5a5d-a909-4e56-8472-1c536c1467f6 tempest-SnapshotsActionsTest-1061400600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.750dd672-f2aa-4ec2-98f4-13c39a4f11cf" returned: 0 in 0.465s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-64df5a5d-a909-4e56-8472-1c536c1467f6 tempest-SnapshotsActionsTest-1061400600 None] Lock "cinder-quobyte-750dd672-f2aa-4ec2-98f4-13c39a4f11cf" released by "_delete_snapshot" :: held 2.236s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:54:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-64df5a5d-a909-4e56-8472-1c536c1467f6 tempest-SnapshotsActionsTest-1061400600 None] Lock "cinder-quobyte-568112a2-95f6-42fa-b50b-220c4e6255a5" released by "delete_snapshot" :: held 2.253s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:54:33 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-64df5a5d-a909-4e56-8472-1c536c1467f6 tempest-SnapshotsActionsTest-1061400600 None] Created reservations ['48ecf603-c817-489d-8fa7-0506480c43fa', '16daa626-977f-4d45-9f72-2865ad1a68fd', 'c9828548-0193-435e-aa22-8b0f66689507', 'a3719ac1-1dd3-4d72-9e62-3143b7d190b5'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:54:33 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-64df5a5d-a909-4e56-8472-1c536c1467f6 tempest-SnapshotsActionsTest-1061400600 None] Delete snapshot completed successfully.
Nov 19 12:54:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-64df5a5d-a909-4e56-8472-1c536c1467f6 tempest-SnapshotsActionsTest-1061400600 None] Lock "cinder-750dd672-f2aa-4ec2-98f4-13c39a4f11cf-delete_snapshot" released by "delete_snapshot" :: held 2.342s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:54:35 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5d004dc8-44e0-45a1-b9a8-8ab76572fc53 tempest-SnapshotsActionsTest-734248391 None] Acquiring lock "cinder-271c598e-cb73-4e10-a691-31e98aac4616-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:54:35 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5d004dc8-44e0-45a1-b9a8-8ab76572fc53 tempest-SnapshotsActionsTest-734248391 None] Lock "cinder-271c598e-cb73-4e10-a691-31e98aac4616-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:54:35 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5d004dc8-44e0-45a1-b9a8-8ab76572fc53 tempest-SnapshotsActionsTest-734248391 None] Acquiring lock "cinder-quobyte-568112a2-95f6-42fa-b50b-220c4e6255a5" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:54:35 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5d004dc8-44e0-45a1-b9a8-8ab76572fc53 tempest-SnapshotsActionsTest-734248391 None] Lock "cinder-quobyte-568112a2-95f6-42fa-b50b-220c4e6255a5" acquired by "delete_snapshot" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:54:35 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5d004dc8-44e0-45a1-b9a8-8ab76572fc53 tempest-SnapshotsActionsTest-734248391 None] Acquiring lock "cinder-quobyte-271c598e-cb73-4e10-a691-31e98aac4616" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:54:35 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5d004dc8-44e0-45a1-b9a8-8ab76572fc53 tempest-SnapshotsActionsTest-734248391 None] Lock "cinder-quobyte-271c598e-cb73-4e10-a691-31e98aac4616" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:54:35 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-5d004dc8-44e0-45a1-b9a8-8ab76572fc53 tempest-SnapshotsActionsTest-734248391 None] Deleting offline snapshot 271c598e-cb73-4e10-a691-31e98aac4616 of volume 568112a2-95f6-42fa-b50b-220c4e6255a5 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 12:54:35 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-5d004dc8-44e0-45a1-b9a8-8ab76572fc53 tempest-SnapshotsActionsTest-734248391 None] snapshot_file for this snap is: volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 12:54:35 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[283137e1-d3b4-45c6-ba66-0dc106a5305d]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:54:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5d004dc8-44e0-45a1-b9a8-8ab76572fc53 tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:35 devstack sudo[86124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616
Nov 19 12:54:35 devstack sudo[86124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:35 devstack sudo[86124]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5d004dc8-44e0-45a1-b9a8-8ab76572fc53 tempest-SnapshotsActionsTest-734248391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616" returned: 0 in 0.565s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:35 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-5d004dc8-44e0-45a1-b9a8-8ab76572fc53 tempest-SnapshotsActionsTest-734248391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-568112a2-95f6-42fa-b50b-220c4e6255a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 12:54:35 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db1757f-a1cd-4754-abc1-36bdef03668a]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:54:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5d004dc8-44e0-45a1-b9a8-8ab76572fc53 tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:35 devstack sudo[86129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5
Nov 19 12:54:35 devstack sudo[86129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:36 devstack sudo[86129]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5d004dc8-44e0-45a1-b9a8-8ab76572fc53 tempest-SnapshotsActionsTest-734248391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5" returned: 0 in 0.579s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5d004dc8-44e0-45a1-b9a8-8ab76572fc53 tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:36 devstack sudo[86134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616
Nov 19 12:54:36 devstack sudo[86134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:36 devstack sudo[86134]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5d004dc8-44e0-45a1-b9a8-8ab76572fc53 tempest-SnapshotsActionsTest-734248391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616" returned: 0 in 0.518s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5d004dc8-44e0-45a1-b9a8-8ab76572fc53 tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:36 devstack sudo[86139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616
Nov 19 12:54:36 devstack sudo[86139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:37 devstack sudo[86139]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5d004dc8-44e0-45a1-b9a8-8ab76572fc53 tempest-SnapshotsActionsTest-734248391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5.271c598e-cb73-4e10-a691-31e98aac4616" returned: 0 in 0.456s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:37 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5d004dc8-44e0-45a1-b9a8-8ab76572fc53 tempest-SnapshotsActionsTest-734248391 None] Lock "cinder-quobyte-271c598e-cb73-4e10-a691-31e98aac4616" released by "_delete_snapshot" :: held 2.176s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:54:37 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5d004dc8-44e0-45a1-b9a8-8ab76572fc53 tempest-SnapshotsActionsTest-734248391 None] Lock "cinder-quobyte-568112a2-95f6-42fa-b50b-220c4e6255a5" released by "delete_snapshot" :: held 2.202s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:54:37 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-5d004dc8-44e0-45a1-b9a8-8ab76572fc53 tempest-SnapshotsActionsTest-734248391 None] Created reservations ['4eb8ddf1-ab1a-468e-a3cd-fb341231ab1c', 'fb2488df-fda4-49c1-9cdc-c77eca672581', 'd652e7ea-1fcd-42b4-bf14-d4a852e0bee7', '053d2eff-684a-462f-be1b-f2d575fde42b'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:54:37 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-5d004dc8-44e0-45a1-b9a8-8ab76572fc53 tempest-SnapshotsActionsTest-734248391 None] Delete snapshot completed successfully.
Nov 19 12:54:37 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5d004dc8-44e0-45a1-b9a8-8ab76572fc53 tempest-SnapshotsActionsTest-734248391 None] Lock "cinder-271c598e-cb73-4e10-a691-31e98aac4616-delete_snapshot" released by "delete_snapshot" :: held 2.290s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:54:38 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-473e9da0-5c40-45b8-9ed6-17ee73ccfe9d tempest-SnapshotsActionsTest-734248391 None] Acquiring lock "cinder-568112a2-95f6-42fa-b50b-220c4e6255a5-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:54:38 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-473e9da0-5c40-45b8-9ed6-17ee73ccfe9d tempest-SnapshotsActionsTest-734248391 None] Lock "cinder-568112a2-95f6-42fa-b50b-220c4e6255a5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:54:38 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-473e9da0-5c40-45b8-9ed6-17ee73ccfe9d tempest-SnapshotsActionsTest-734248391 None] Acquiring lock "cinder-quobyte-568112a2-95f6-42fa-b50b-220c4e6255a5" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:54:38 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-473e9da0-5c40-45b8-9ed6-17ee73ccfe9d tempest-SnapshotsActionsTest-734248391 None] Lock "cinder-quobyte-568112a2-95f6-42fa-b50b-220c4e6255a5" acquired by "delete_volume" :: waited 0.014s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:54:38 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b646952-234f-44fe-9624-7c0593ad5ce5]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:54:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-473e9da0-5c40-45b8-9ed6-17ee73ccfe9d tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:38 devstack sudo[86143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5
Nov 19 12:54:38 devstack sudo[86143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:38 devstack sudo[86143]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-473e9da0-5c40-45b8-9ed6-17ee73ccfe9d tempest-SnapshotsActionsTest-734248391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5" returned: 0 in 0.583s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-473e9da0-5c40-45b8-9ed6-17ee73ccfe9d tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:38 devstack sudo[86148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5
Nov 19 12:54:38 devstack sudo[86148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:39 devstack sudo[86148]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-473e9da0-5c40-45b8-9ed6-17ee73ccfe9d tempest-SnapshotsActionsTest-734248391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-568112a2-95f6-42fa-b50b-220c4e6255a5" returned: 0 in 0.494s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:39 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-473e9da0-5c40-45b8-9ed6-17ee73ccfe9d tempest-SnapshotsActionsTest-734248391 None] Lock "cinder-quobyte-568112a2-95f6-42fa-b50b-220c4e6255a5" released by "delete_volume" :: held 1.114s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:54:39 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-473e9da0-5c40-45b8-9ed6-17ee73ccfe9d tempest-SnapshotsActionsTest-734248391 None] Created reservations ['80df68d1-24d4-4955-b7a3-442f1efefed6', 'ef9dbb4c-64cd-4ef3-bc46-71dde246820d', '1e8e9bae-1a5b-4db5-a56f-ace25e349907', '3f1cb693-0e0d-4fd2-a1d6-6305a013c35d'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:54:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-473e9da0-5c40-45b8-9ed6-17ee73ccfe9d tempest-SnapshotsActionsTest-734248391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:54:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-473e9da0-5c40-45b8-9ed6-17ee73ccfe9d tempest-SnapshotsActionsTest-734248391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:54:39 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-473e9da0-5c40-45b8-9ed6-17ee73ccfe9d tempest-SnapshotsActionsTest-734248391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:54:39 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-473e9da0-5c40-45b8-9ed6-17ee73ccfe9d tempest-SnapshotsActionsTest-734248391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:54:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-473e9da0-5c40-45b8-9ed6-17ee73ccfe9d tempest-SnapshotsActionsTest-734248391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:54:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-473e9da0-5c40-45b8-9ed6-17ee73ccfe9d tempest-SnapshotsActionsTest-734248391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:39 devstack sudo[86151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:54:39 devstack sudo[86151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:39 devstack sudo[86151]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-473e9da0-5c40-45b8-9ed6-17ee73ccfe9d tempest-SnapshotsActionsTest-734248391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.471s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:39 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-473e9da0-5c40-45b8-9ed6-17ee73ccfe9d tempest-SnapshotsActionsTest-734248391 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:54:39 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-473e9da0-5c40-45b8-9ed6-17ee73ccfe9d tempest-SnapshotsActionsTest-734248391 None] Deleted volume successfully.
Nov 19 12:54:40 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-473e9da0-5c40-45b8-9ed6-17ee73ccfe9d tempest-SnapshotsActionsTest-734248391 None] Lock "cinder-568112a2-95f6-42fa-b50b-220c4e6255a5-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:54:49 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:UPDATE=51,cinder:SELECT=44,cinder:INSERT=17,cinder:DELETE=5 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:54:49 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:UPDATE=48,cinder:SELECT=52,cinder:DELETE=3,cinder:INSERT=8 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:54:54 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-e6c75097-5f77-4aa7-8abc-f7c06a0b0438 req-4e67ffa1-ce95-4c1b-adeb-4086cc466762 tempest-TaggedBootDevicesTest_v242-995872979 None] Terminate volume connection completed successfully.
Nov 19 12:54:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-e6c75097-5f77-4aa7-8abc-f7c06a0b0438 req-4e67ffa1-ce95-4c1b-adeb-4086cc466762 tempest-TaggedBootDevicesTest_v242-995872979 None] Deleting attachment cf46b209-6f2b-497a-a2ae-31b5dd30eef2. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 12:54:55 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-e6c75097-5f77-4aa7-8abc-f7c06a0b0438 req-4022bbf6-799e-4f5a-b75e-c1ea9667a7f4 tempest-TaggedBootDevicesTest_v242-995872979 None] Terminate volume connection completed successfully.
Nov 19 12:54:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-e6c75097-5f77-4aa7-8abc-f7c06a0b0438 req-4022bbf6-799e-4f5a-b75e-c1ea9667a7f4 tempest-TaggedBootDevicesTest_v242-995872979 None] Deleting attachment 890bf0f3-1967-4bd9-90d6-6f4741945989. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 12:54:56 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-e6c75097-5f77-4aa7-8abc-f7c06a0b0438 req-769c3c9a-79fd-40fd-971d-039d20f383b5 tempest-TaggedBootDevicesTest_v242-995872979 None] Terminate volume connection completed successfully.
Nov 19 12:54:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-e6c75097-5f77-4aa7-8abc-f7c06a0b0438 req-769c3c9a-79fd-40fd-971d-039d20f383b5 tempest-TaggedBootDevicesTest_v242-995872979 None] Deleting attachment 23b5d9a5-6dfd-42ce-9a52-c807b05f44b1. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 12:54:59 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:54:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Flow 'volume_create_manager' (55f5ebe1-a5b5-42fb-b676-c154dc7325f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:54:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4ff98d-7da3-406e-8bc8-9a93e9e9ec1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:54:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4ff98d-7da3-406e-8bc8-9a93e9e9ec1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1604555805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ceae91-79d2-4812-9865-9d55e8c613da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='908f6a83718d46109e1a08cd36ab6007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:54:59Z,use_quota=True,user_id='2149ca35ef8542b283ced037650206c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:54:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d40cef91-9fd9-441d-bd8b-42146a89db7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:54:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d40cef91-9fd9-441d-bd8b-42146a89db7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:54:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248ec131-cb7b-4992-afc7-b3862e5e5c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:54:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248ec131-cb7b-4992-afc7-b3862e5e5c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2ceae91-79d2-4812-9865-9d55e8c613da', 'volume_name': 'volume-e2ceae91-79d2-4812-9865-9d55e8c613da', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:54:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1c2c11-6a45-4cd1-aded-ebe82f6e5a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:54:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1c2c11-6a45-4cd1-aded-ebe82f6e5a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:54:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6f5d5f-1e56-437a-92be-1a9cb6647b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:54:59 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Volume e2ceae91-79d2-4812-9865-9d55e8c613da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2ceae91-79d2-4812-9865-9d55e8c613da', 'volume_size': 1}
Nov 19 12:54:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:54:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:54:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1604555805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ceae91-79d2-4812-9865-9d55e8c613da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='908f6a83718d46109e1a08cd36ab6007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:54:59Z,use_quota=True,user_id='2149ca35ef8542b283ced037650206c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:54:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Creating volume e2ceae91-79d2-4812-9865-9d55e8c613da {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:54:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:54:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:54:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:54:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:54:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:54:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:54:59 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:54:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e2ceae91-79d2-4812-9865-9d55e8c613da 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:59 devstack sudo[86573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e2ceae91-79d2-4812-9865-9d55e8c613da 1073741824
Nov 19 12:54:59 devstack sudo[86573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:54:59 devstack sudo[86573]: pam_unix(sudo:session): session closed for user root
Nov 19 12:54:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e2ceae91-79d2-4812-9865-9d55e8c613da 1073741824" returned: 0 in 0.535s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:54:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e2ceae91-79d2-4812-9865-9d55e8c613da {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:54:59 devstack sudo[86578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e2ceae91-79d2-4812-9865-9d55e8c613da
Nov 19 12:54:59 devstack sudo[86578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:00 devstack sudo[86578]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e2ceae91-79d2-4812-9865-9d55e8c613da" returned: 0 in 0.510s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:00 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:55:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:55:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6f5d5f-1e56-437a-92be-1a9cb6647b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2ceae91-79d2-4812-9865-9d55e8c613da', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4acf0633-82b0-480a-93ed-d3fcce281684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:00 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Volume volume-e2ceae91-79d2-4812-9865-9d55e8c613da (e2ceae91-79d2-4812-9865-9d55e8c613da): created successfully
Nov 19 12:55:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4acf0633-82b0-480a-93ed-d3fcce281684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Flow 'volume_create_manager' (55f5ebe1-a5b5-42fb-b676-c154dc7325f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:55:00 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-a063ac7b-2152-4f0b-8222-91482bd24d6d tempest-VolumesServicesTestJSON-481219756 None] Created volume successfully.
Nov 19 12:55:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b6e7e2cf-d127-4598-ba17-7fffde0df2ad tempest-VolumesServicesTestJSON-481219756 None] Acquiring lock "cinder-e2ceae91-79d2-4812-9865-9d55e8c613da-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:55:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b6e7e2cf-d127-4598-ba17-7fffde0df2ad tempest-VolumesServicesTestJSON-481219756 None] Lock "cinder-e2ceae91-79d2-4812-9865-9d55e8c613da-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:55:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b6e7e2cf-d127-4598-ba17-7fffde0df2ad tempest-VolumesServicesTestJSON-481219756 None] Acquiring lock "cinder-quobyte-e2ceae91-79d2-4812-9865-9d55e8c613da" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:55:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b6e7e2cf-d127-4598-ba17-7fffde0df2ad tempest-VolumesServicesTestJSON-481219756 None] Lock "cinder-quobyte-e2ceae91-79d2-4812-9865-9d55e8c613da" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:55:01 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5716ffd0-29e3-46af-8afb-8d32c122cfb0]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:55:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b6e7e2cf-d127-4598-ba17-7fffde0df2ad tempest-VolumesServicesTestJSON-481219756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e2ceae91-79d2-4812-9865-9d55e8c613da {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:01 devstack sudo[86581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e2ceae91-79d2-4812-9865-9d55e8c613da
Nov 19 12:55:01 devstack sudo[86581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:02 devstack sudo[86581]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b6e7e2cf-d127-4598-ba17-7fffde0df2ad tempest-VolumesServicesTestJSON-481219756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e2ceae91-79d2-4812-9865-9d55e8c613da" returned: 0 in 0.847s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b6e7e2cf-d127-4598-ba17-7fffde0df2ad tempest-VolumesServicesTestJSON-481219756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e2ceae91-79d2-4812-9865-9d55e8c613da {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:02 devstack sudo[86730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e2ceae91-79d2-4812-9865-9d55e8c613da
Nov 19 12:55:02 devstack sudo[86730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:02 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d201b3b5-27c4-4c2f-9a0d-b518a88e1262 tempest-TaggedBootDevicesTest_v242-995872979 None] Acquiring lock "cinder-4ce87d79-18f5-43dc-acb2-639edfb8dacc-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:55:02 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d201b3b5-27c4-4c2f-9a0d-b518a88e1262 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "cinder-4ce87d79-18f5-43dc-acb2-639edfb8dacc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:55:02 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d201b3b5-27c4-4c2f-9a0d-b518a88e1262 tempest-TaggedBootDevicesTest_v242-995872979 None] Acquiring lock "cinder-quobyte-4ce87d79-18f5-43dc-acb2-639edfb8dacc" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:55:02 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d201b3b5-27c4-4c2f-9a0d-b518a88e1262 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "cinder-quobyte-4ce87d79-18f5-43dc-acb2-639edfb8dacc" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:55:02 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dede9f1-c8cb-44e4-a95a-6be8aa4fbb7a]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:55:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d201b3b5-27c4-4c2f-9a0d-b518a88e1262 tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4ce87d79-18f5-43dc-acb2-639edfb8dacc {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:02 devstack sudo[86734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4ce87d79-18f5-43dc-acb2-639edfb8dacc
Nov 19 12:55:02 devstack sudo[86734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:02 devstack sudo[86730]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b6e7e2cf-d127-4598-ba17-7fffde0df2ad tempest-VolumesServicesTestJSON-481219756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e2ceae91-79d2-4812-9865-9d55e8c613da" returned: 0 in 0.623s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:02 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b6e7e2cf-d127-4598-ba17-7fffde0df2ad tempest-VolumesServicesTestJSON-481219756 None] Lock "cinder-quobyte-e2ceae91-79d2-4812-9865-9d55e8c613da" released by "delete_volume" :: held 1.491s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:55:02 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-b6e7e2cf-d127-4598-ba17-7fffde0df2ad tempest-VolumesServicesTestJSON-481219756 None] Created reservations ['522a9c77-9b88-4893-878e-42ca5cec13c2', '9ae5586a-f911-4601-a206-879cb6dec63a', '0929c66e-f154-41bb-9fb8-debdf68a515f', '465e6186-1c7e-4c1b-a752-6bf31cc00304'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:55:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b6e7e2cf-d127-4598-ba17-7fffde0df2ad tempest-VolumesServicesTestJSON-481219756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:55:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b6e7e2cf-d127-4598-ba17-7fffde0df2ad tempest-VolumesServicesTestJSON-481219756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:55:03 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b6e7e2cf-d127-4598-ba17-7fffde0df2ad tempest-VolumesServicesTestJSON-481219756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:55:03 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b6e7e2cf-d127-4598-ba17-7fffde0df2ad tempest-VolumesServicesTestJSON-481219756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:55:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b6e7e2cf-d127-4598-ba17-7fffde0df2ad tempest-VolumesServicesTestJSON-481219756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:55:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b6e7e2cf-d127-4598-ba17-7fffde0df2ad tempest-VolumesServicesTestJSON-481219756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:03 devstack sudo[86737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:55:03 devstack sudo[86737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:03 devstack sudo[86734]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d201b3b5-27c4-4c2f-9a0d-b518a88e1262 tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4ce87d79-18f5-43dc-acb2-639edfb8dacc" returned: 0 in 0.552s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d201b3b5-27c4-4c2f-9a0d-b518a88e1262 tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4ce87d79-18f5-43dc-acb2-639edfb8dacc {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:03 devstack sudo[86742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4ce87d79-18f5-43dc-acb2-639edfb8dacc
Nov 19 12:55:03 devstack sudo[86742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:03 devstack sudo[86737]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b6e7e2cf-d127-4598-ba17-7fffde0df2ad tempest-VolumesServicesTestJSON-481219756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.469s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:03 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-b6e7e2cf-d127-4598-ba17-7fffde0df2ad tempest-VolumesServicesTestJSON-481219756 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:55:03 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-b6e7e2cf-d127-4598-ba17-7fffde0df2ad tempest-VolumesServicesTestJSON-481219756 None] Deleted volume successfully.
Nov 19 12:55:03 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b6e7e2cf-d127-4598-ba17-7fffde0df2ad tempest-VolumesServicesTestJSON-481219756 None] Lock "cinder-e2ceae91-79d2-4812-9865-9d55e8c613da-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:55:03 devstack sudo[86742]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d201b3b5-27c4-4c2f-9a0d-b518a88e1262 tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4ce87d79-18f5-43dc-acb2-639edfb8dacc" returned: 0 in 0.505s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:03 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d201b3b5-27c4-4c2f-9a0d-b518a88e1262 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "cinder-quobyte-4ce87d79-18f5-43dc-acb2-639edfb8dacc" released by "delete_volume" :: held 1.077s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:55:03 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-d201b3b5-27c4-4c2f-9a0d-b518a88e1262 tempest-TaggedBootDevicesTest_v242-995872979 None] Created reservations ['01ec0e99-a275-4e89-a09a-a62f4eb541ee', '0007437f-9552-4e47-933d-4d94b78b53e2', 'ffac1f46-735d-45b5-a01c-12c306dd2cd8', '2b5342ab-6993-40c4-bff5-815f3eb357a8'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:55:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d201b3b5-27c4-4c2f-9a0d-b518a88e1262 tempest-TaggedBootDevicesTest_v242-995872979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:55:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d201b3b5-27c4-4c2f-9a0d-b518a88e1262 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:55:03 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d201b3b5-27c4-4c2f-9a0d-b518a88e1262 tempest-TaggedBootDevicesTest_v242-995872979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:55:03 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d201b3b5-27c4-4c2f-9a0d-b518a88e1262 tempest-TaggedBootDevicesTest_v242-995872979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:55:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d201b3b5-27c4-4c2f-9a0d-b518a88e1262 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:55:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d201b3b5-27c4-4c2f-9a0d-b518a88e1262 tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:03 devstack sudo[86746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:55:03 devstack sudo[86746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:04 devstack sudo[86746]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d201b3b5-27c4-4c2f-9a0d-b518a88e1262 tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.487s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:04 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-d201b3b5-27c4-4c2f-9a0d-b518a88e1262 tempest-TaggedBootDevicesTest_v242-995872979 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:55:04 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-d201b3b5-27c4-4c2f-9a0d-b518a88e1262 tempest-TaggedBootDevicesTest_v242-995872979 None] Deleted volume successfully.
Nov 19 12:55:04 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d201b3b5-27c4-4c2f-9a0d-b518a88e1262 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "cinder-4ce87d79-18f5-43dc-acb2-639edfb8dacc-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:55:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 12:55:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:55:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:55:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:55:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:55:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:55:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:04 devstack sudo[86749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:55:04 devstack sudo[86749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:04 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-935982af-591a-4d99-b5c4-34d90459ccf0 tempest-TaggedBootDevicesTest_v242-995872979 None] Acquiring lock "cinder-445bd5af-207c-4c72-9eb8-d1189278de39-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:55:04 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-935982af-591a-4d99-b5c4-34d90459ccf0 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "cinder-445bd5af-207c-4c72-9eb8-d1189278de39-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:55:04 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-935982af-591a-4d99-b5c4-34d90459ccf0 tempest-TaggedBootDevicesTest_v242-995872979 None] Acquiring lock "cinder-quobyte-445bd5af-207c-4c72-9eb8-d1189278de39" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:55:04 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-935982af-591a-4d99-b5c4-34d90459ccf0 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "cinder-quobyte-445bd5af-207c-4c72-9eb8-d1189278de39" acquired by "delete_volume" :: waited 0.013s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:55:04 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7269403b-0402-4542-b475-7b70a57d5ea7]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:55:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-935982af-591a-4d99-b5c4-34d90459ccf0 tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-445bd5af-207c-4c72-9eb8-d1189278de39 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:05 devstack sudo[86751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-445bd5af-207c-4c72-9eb8-d1189278de39
Nov 19 12:55:05 devstack sudo[86751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:05 devstack sudo[86749]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.598s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:05 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:55:05 devstack sudo[86751]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-935982af-591a-4d99-b5c4-34d90459ccf0 tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-445bd5af-207c-4c72-9eb8-d1189278de39" returned: 0 in 0.671s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-935982af-591a-4d99-b5c4-34d90459ccf0 tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-445bd5af-207c-4c72-9eb8-d1189278de39 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:05 devstack sudo[86757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-445bd5af-207c-4c72-9eb8-d1189278de39
Nov 19 12:55:05 devstack sudo[86757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:06 devstack sudo[86757]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-935982af-591a-4d99-b5c4-34d90459ccf0 tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-445bd5af-207c-4c72-9eb8-d1189278de39" returned: 0 in 0.479s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-935982af-591a-4d99-b5c4-34d90459ccf0 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "cinder-quobyte-445bd5af-207c-4c72-9eb8-d1189278de39" released by "delete_volume" :: held 1.172s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-935982af-591a-4d99-b5c4-34d90459ccf0 tempest-TaggedBootDevicesTest_v242-995872979 None] Created reservations ['47d15348-999a-41fc-aff9-7f33e4ae354d', 'd9497ba3-097e-4ac4-bf30-4857f11af9da', '3b8f993b-49ab-4fc2-8328-7c37c4edaef5', '24a455ac-a3da-4d1d-b5fd-b62a97b13e96'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-935982af-591a-4d99-b5c4-34d90459ccf0 tempest-TaggedBootDevicesTest_v242-995872979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-935982af-591a-4d99-b5c4-34d90459ccf0 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-935982af-591a-4d99-b5c4-34d90459ccf0 tempest-TaggedBootDevicesTest_v242-995872979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-935982af-591a-4d99-b5c4-34d90459ccf0 tempest-TaggedBootDevicesTest_v242-995872979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-935982af-591a-4d99-b5c4-34d90459ccf0 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-935982af-591a-4d99-b5c4-34d90459ccf0 tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:06 devstack sudo[86760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:55:06 devstack sudo[86760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:06 devstack sudo[86760]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-935982af-591a-4d99-b5c4-34d90459ccf0 tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.485s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-935982af-591a-4d99-b5c4-34d90459ccf0 tempest-TaggedBootDevicesTest_v242-995872979 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:55:06 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-935982af-591a-4d99-b5c4-34d90459ccf0 tempest-TaggedBootDevicesTest_v242-995872979 None] Deleted volume successfully.
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-935982af-591a-4d99-b5c4-34d90459ccf0 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "cinder-445bd5af-207c-4c72-9eb8-d1189278de39-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Flow 'volume_create_manager' (97fe354f-b274-4280-929f-3b6fec018ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab80fbec-be0c-4915-97b7-c175b7b17651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab80fbec-be0c-4915-97b7-c175b7b17651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1795587334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c709b8b-1d6b-4c90-88ce-147bf54758f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcbb0dd3b8fa40ceba8a121624b86126',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:55:07Z,use_quota=True,user_id='980b616303f249e892d70418e98324bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b263e85-b31e-4a9b-8fbf-113badb74263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b263e85-b31e-4a9b-8fbf-113badb74263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104873f1-ea1a-478a-be9a-96ae8bcb0aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104873f1-ea1a-478a-be9a-96ae8bcb0aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c709b8b-1d6b-4c90-88ce-147bf54758f1', 'volume_name': 'volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f43f0f-abae-42b1-9d0d-93c03ac98efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f43f0f-abae-42b1-9d0d-93c03ac98efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0419e16-23b0-49fa-bbeb-b5b42dbb0963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:06 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Volume 1c709b8b-1d6b-4c90-88ce-147bf54758f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1', 'volume_size': 1}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1795587334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c709b8b-1d6b-4c90-88ce-147bf54758f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcbb0dd3b8fa40ceba8a121624b86126',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:55:07Z,use_quota=True,user_id='980b616303f249e892d70418e98324bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Creating volume 1c709b8b-1d6b-4c90-88ce-147bf54758f1 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:55:06 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:55:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:07 devstack sudo[86763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1 1073741824
Nov 19 12:55:07 devstack sudo[86763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:07 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-08370edc-8ee9-4b3c-ac46-2f45c895ad50 tempest-TaggedBootDevicesTest_v242-995872979 None] Acquiring lock "cinder-66f25197-d16c-4e7d-a464-ca749115b4e4-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:55:07 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-08370edc-8ee9-4b3c-ac46-2f45c895ad50 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "cinder-66f25197-d16c-4e7d-a464-ca749115b4e4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:55:07 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-08370edc-8ee9-4b3c-ac46-2f45c895ad50 tempest-TaggedBootDevicesTest_v242-995872979 None] Acquiring lock "cinder-quobyte-66f25197-d16c-4e7d-a464-ca749115b4e4" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:55:07 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-08370edc-8ee9-4b3c-ac46-2f45c895ad50 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "cinder-quobyte-66f25197-d16c-4e7d-a464-ca749115b4e4" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:55:07 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef1264c-1d34-4a1f-b137-ba3d6438f018]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:55:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-08370edc-8ee9-4b3c-ac46-2f45c895ad50 tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:07 devstack sudo[86765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4
Nov 19 12:55:07 devstack sudo[86765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:07 devstack sudo[86763]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1 1073741824" returned: 0 in 0.582s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:07 devstack sudo[86776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1
Nov 19 12:55:07 devstack sudo[86776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:07 devstack sudo[86765]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-08370edc-8ee9-4b3c-ac46-2f45c895ad50 tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4" returned: 0 in 0.557s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-08370edc-8ee9-4b3c-ac46-2f45c895ad50 tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:07 devstack sudo[86780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4
Nov 19 12:55:07 devstack sudo[86780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:08 devstack sudo[86776]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1" returned: 0 in 0.449s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:08 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:55:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:55:08 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0419e16-23b0-49fa-bbeb-b5b42dbb0963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:08 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eaa9833-bf0c-41bd-ab6d-ea2b573d939d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:08 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Volume volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1 (1c709b8b-1d6b-4c90-88ce-147bf54758f1): created successfully
Nov 19 12:55:08 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eaa9833-bf0c-41bd-ab6d-ea2b573d939d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:08 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Flow 'volume_create_manager' (97fe354f-b274-4280-929f-3b6fec018ca5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:55:08 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-a5f83165-387c-4f6f-96b2-519b8f51734f tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Created volume successfully.
Nov 19 12:55:08 devstack sudo[86780]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-08370edc-8ee9-4b3c-ac46-2f45c895ad50 tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4" returned: 1 in 0.567s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-08370edc-8ee9-4b3c-ac46-2f45c895ad50 tempest-TaggedBootDevicesTest_v242-995872979 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 12:55:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-08370edc-8ee9-4b3c-ac46-2f45c895ad50 tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:08 devstack sudo[86786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4
Nov 19 12:55:08 devstack sudo[86786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:08 devstack sudo[86786]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-08370edc-8ee9-4b3c-ac46-2f45c895ad50 tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-66f25197-d16c-4e7d-a464-ca749115b4e4" returned: 0 in 0.436s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:08 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-08370edc-8ee9-4b3c-ac46-2f45c895ad50 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "cinder-quobyte-66f25197-d16c-4e7d-a464-ca749115b4e4" released by "delete_volume" :: held 1.601s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:55:08 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-08370edc-8ee9-4b3c-ac46-2f45c895ad50 tempest-TaggedBootDevicesTest_v242-995872979 None] Created reservations ['b166b155-c5ef-44c1-8f92-d163396be348', '84b05a2b-dc64-4625-bf14-7c78e9016ef5', 'a74bf89e-de7b-4153-a71d-b21d81cf0692', '4aa78762-c913-49da-bd71-23d3701fd3c0'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:55:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-08370edc-8ee9-4b3c-ac46-2f45c895ad50 tempest-TaggedBootDevicesTest_v242-995872979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:55:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-08370edc-8ee9-4b3c-ac46-2f45c895ad50 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:55:08 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-08370edc-8ee9-4b3c-ac46-2f45c895ad50 tempest-TaggedBootDevicesTest_v242-995872979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:55:08 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-08370edc-8ee9-4b3c-ac46-2f45c895ad50 tempest-TaggedBootDevicesTest_v242-995872979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:55:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-08370edc-8ee9-4b3c-ac46-2f45c895ad50 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:55:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-08370edc-8ee9-4b3c-ac46-2f45c895ad50 tempest-TaggedBootDevicesTest_v242-995872979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:08 devstack sudo[86789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:55:08 devstack sudo[86789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9f761a28-2603-4170-acd0-2c4f9e407c75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:55:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9f761a28-2603-4170-acd0-2c4f9e407c75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:55:09 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-9f761a28-2603-4170-acd0-2c4f9e407c75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Creating offline snapshot 67666407-11c7-4567-adf1-3c3a44136c14 of volume 1c709b8b-1d6b-4c90-88ce-147bf54758f1 {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 12:55:09 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de94af9-387b-47aa-88ca-b77db16c37a7]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:55:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f761a28-2603-4170-acd0-2c4f9e407c75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:09 devstack sudo[86789]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-08370edc-8ee9-4b3c-ac46-2f45c895ad50 tempest-TaggedBootDevicesTest_v242-995872979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.508s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:09 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-08370edc-8ee9-4b3c-ac46-2f45c895ad50 tempest-TaggedBootDevicesTest_v242-995872979 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:55:09 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-08370edc-8ee9-4b3c-ac46-2f45c895ad50 tempest-TaggedBootDevicesTest_v242-995872979 None] Deleted volume successfully.
Nov 19 12:55:09 devstack sudo[86791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1
Nov 19 12:55:09 devstack sudo[86791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:09 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-08370edc-8ee9-4b3c-ac46-2f45c895ad50 tempest-TaggedBootDevicesTest_v242-995872979 None] Lock "cinder-66f25197-d16c-4e7d-a464-ca749115b4e4-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:55:09 devstack sudo[86791]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f761a28-2603-4170-acd0-2c4f9e407c75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1" returned: 0 in 0.606s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f761a28-2603-4170-acd0-2c4f9e407c75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1.67666407-11c7-4567-adf1-3c3a44136c14 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:09 devstack sudo[86797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1.67666407-11c7-4567-adf1-3c3a44136c14 1G
Nov 19 12:55:09 devstack sudo[86797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:10 devstack sudo[86797]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f761a28-2603-4170-acd0-2c4f9e407c75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1.67666407-11c7-4567-adf1-3c3a44136c14 1G" returned: 0 in 0.578s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f761a28-2603-4170-acd0-2c4f9e407c75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1.67666407-11c7-4567-adf1-3c3a44136c14 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:10 devstack sudo[86803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1.67666407-11c7-4567-adf1-3c3a44136c14
Nov 19 12:55:10 devstack sudo[86803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:10 devstack sudo[86803]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f761a28-2603-4170-acd0-2c4f9e407c75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1.67666407-11c7-4567-adf1-3c3a44136c14" returned: 0 in 0.521s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:10 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-9f761a28-2603-4170-acd0-2c4f9e407c75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1.67666407-11c7-4567-adf1-3c3a44136c14 is being set with open permissions: ugo+rw
Nov 19 12:55:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f761a28-2603-4170-acd0-2c4f9e407c75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1.67666407-11c7-4567-adf1-3c3a44136c14 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:10 devstack sudo[86893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1.67666407-11c7-4567-adf1-3c3a44136c14
Nov 19 12:55:10 devstack sudo[86893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:11 devstack sudo[86893]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f761a28-2603-4170-acd0-2c4f9e407c75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1.67666407-11c7-4567-adf1-3c3a44136c14" returned: 0 in 0.463s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f761a28-2603-4170-acd0-2c4f9e407c75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:11 devstack sudo[86896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1.info
Nov 19 12:55:11 devstack sudo[86896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:11 devstack sudo[86896]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f761a28-2603-4170-acd0-2c4f9e407c75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1.info" returned: 0 in 0.496s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:11 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-9f761a28-2603-4170-acd0-2c4f9e407c75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1.info is being set with open permissions: ugo+rw
Nov 19 12:55:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f761a28-2603-4170-acd0-2c4f9e407c75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:11 devstack sudo[86902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1.info
Nov 19 12:55:11 devstack sudo[86902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:12 devstack sudo[86902]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f761a28-2603-4170-acd0-2c4f9e407c75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1.info" returned: 0 in 0.550s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9f761a28-2603-4170-acd0-2c4f9e407c75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.261s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:55:12 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-9f761a28-2603-4170-acd0-2c4f9e407c75 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Create snapshot completed successfully
Nov 19 12:55:13 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-84c0080d-be31-4344-b5e2-1cbe91559538 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Acquiring lock "cinder-67666407-11c7-4567-adf1-3c3a44136c14-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:55:13 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-84c0080d-be31-4344-b5e2-1cbe91559538 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Lock "cinder-67666407-11c7-4567-adf1-3c3a44136c14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:55:13 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-84c0080d-be31-4344-b5e2-1cbe91559538 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Acquiring lock "cinder-quobyte-1c709b8b-1d6b-4c90-88ce-147bf54758f1" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:55:13 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-84c0080d-be31-4344-b5e2-1cbe91559538 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Lock "cinder-quobyte-1c709b8b-1d6b-4c90-88ce-147bf54758f1" acquired by "delete_snapshot" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:55:13 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-84c0080d-be31-4344-b5e2-1cbe91559538 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Acquiring lock "cinder-quobyte-67666407-11c7-4567-adf1-3c3a44136c14" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:55:13 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-84c0080d-be31-4344-b5e2-1cbe91559538 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Lock "cinder-quobyte-67666407-11c7-4567-adf1-3c3a44136c14" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:55:13 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-84c0080d-be31-4344-b5e2-1cbe91559538 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Deleting offline snapshot 67666407-11c7-4567-adf1-3c3a44136c14 of volume 1c709b8b-1d6b-4c90-88ce-147bf54758f1 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 12:55:13 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-84c0080d-be31-4344-b5e2-1cbe91559538 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] snapshot_file for this snap is: volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1.67666407-11c7-4567-adf1-3c3a44136c14 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 12:55:13 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af00e6f-8418-4eee-ae5d-2b57cb7d5e2b]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:55:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-84c0080d-be31-4344-b5e2-1cbe91559538 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1.67666407-11c7-4567-adf1-3c3a44136c14 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:13 devstack sudo[86907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1.67666407-11c7-4567-adf1-3c3a44136c14
Nov 19 12:55:13 devstack sudo[86907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:14 devstack sudo[86907]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-84c0080d-be31-4344-b5e2-1cbe91559538 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1.67666407-11c7-4567-adf1-3c3a44136c14" returned: 0 in 0.721s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:14 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-84c0080d-be31-4344-b5e2-1cbe91559538 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 12:55:14 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c6c843-7d47-4e80-b3d8-bd1c53e22473]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:55:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-84c0080d-be31-4344-b5e2-1cbe91559538 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:14 devstack sudo[86913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1
Nov 19 12:55:14 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:15 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-84c0080d-be31-4344-b5e2-1cbe91559538 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1" returned: 0 in 0.887s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-84c0080d-be31-4344-b5e2-1cbe91559538 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1.67666407-11c7-4567-adf1-3c3a44136c14 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:15 devstack sudo[86953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1.67666407-11c7-4567-adf1-3c3a44136c14
Nov 19 12:55:15 devstack sudo[86953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:15 devstack sudo[86953]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-84c0080d-be31-4344-b5e2-1cbe91559538 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1.67666407-11c7-4567-adf1-3c3a44136c14" returned: 0 in 0.568s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-84c0080d-be31-4344-b5e2-1cbe91559538 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1.67666407-11c7-4567-adf1-3c3a44136c14 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:15 devstack sudo[86958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1.67666407-11c7-4567-adf1-3c3a44136c14
Nov 19 12:55:15 devstack sudo[86958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:16 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-62296f11-153d-4f1d-b669-48588909f047 tempest-ServerActionsV293TestJSON-1607053477 None] Terminate volume connection completed successfully.
Nov 19 12:55:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-62296f11-153d-4f1d-b669-48588909f047 tempest-ServerActionsV293TestJSON-1607053477 None] Deleting attachment cd0e750c-a545-4143-b7e7-d650bb7f668e. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 12:55:16 devstack sudo[86958]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-84c0080d-be31-4344-b5e2-1cbe91559538 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1.67666407-11c7-4567-adf1-3c3a44136c14" returned: 0 in 0.518s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:16 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-84c0080d-be31-4344-b5e2-1cbe91559538 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Lock "cinder-quobyte-67666407-11c7-4567-adf1-3c3a44136c14" released by "_delete_snapshot" :: held 2.769s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:55:16 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-84c0080d-be31-4344-b5e2-1cbe91559538 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Lock "cinder-quobyte-1c709b8b-1d6b-4c90-88ce-147bf54758f1" released by "delete_snapshot" :: held 2.787s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:55:16 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-84c0080d-be31-4344-b5e2-1cbe91559538 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Created reservations ['c62e7377-eb79-4312-98d3-c990a17a6442', '2bea9e71-9d73-43f4-8718-c57eb557e822', '469624dd-4fa7-4a5c-9f12-c4c9289d6248', '0c41144b-1158-4982-bb16-2326aef79e4b'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:55:16 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-84c0080d-be31-4344-b5e2-1cbe91559538 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Delete snapshot completed successfully.
Nov 19 12:55:16 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-84c0080d-be31-4344-b5e2-1cbe91559538 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Lock "cinder-67666407-11c7-4567-adf1-3c3a44136c14-delete_snapshot" released by "delete_snapshot" :: held 2.908s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:55:16 devstack cinder-volume[80839]: DEBUG cinder.image.glance [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] Creating Keystone auth plugin from conf {{(pid=80839) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Nov 19 12:55:16 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9f2a7138-d4a2-41ba-8ad7-400bafa4f9b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Acquiring lock "cinder-1c709b8b-1d6b-4c90-88ce-147bf54758f1-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:55:16 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9f2a7138-d4a2-41ba-8ad7-400bafa4f9b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Lock "cinder-1c709b8b-1d6b-4c90-88ce-147bf54758f1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:55:17 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9f2a7138-d4a2-41ba-8ad7-400bafa4f9b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Acquiring lock "cinder-quobyte-1c709b8b-1d6b-4c90-88ce-147bf54758f1" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:55:17 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9f2a7138-d4a2-41ba-8ad7-400bafa4f9b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Lock "cinder-quobyte-1c709b8b-1d6b-4c90-88ce-147bf54758f1" acquired by "delete_volume" :: waited 0.049s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:55:17 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0e5a45-7943-4827-9c73-fd86f309f9da]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:55:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f2a7138-d4a2-41ba-8ad7-400bafa4f9b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:17 devstack cinder-volume[80839]: DEBUG cinder.volume.volume_utils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] Attempting download of 5d491c17-c417-4a2b-886e-ad2958917626 ((None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}])) to volume 1852d1f9-6022-4da9-aec1-3cc6ec90b974. {{(pid=80839) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Nov 19 12:55:17 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c168ebcb-d685-4e23-9a9b-562756411bc7]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:55:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_7la6qhab {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:17 devstack sudo[86963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1
Nov 19 12:55:17 devstack sudo[86963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:17 devstack sudo[86964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_7la6qhab
Nov 19 12:55:17 devstack sudo[86964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:17 devstack sudo[86963]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f2a7138-d4a2-41ba-8ad7-400bafa4f9b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1" returned: 0 in 0.701s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f2a7138-d4a2-41ba-8ad7-400bafa4f9b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:17 devstack sudo[86972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1
Nov 19 12:55:17 devstack sudo[86972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:17 devstack sudo[86964]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_7la6qhab" returned: 0 in 0.670s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_7la6qhab {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:18 devstack sudo[86974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_7la6qhab
Nov 19 12:55:18 devstack sudo[86974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:18 devstack sudo[86972]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f2a7138-d4a2-41ba-8ad7-400bafa4f9b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1c709b8b-1d6b-4c90-88ce-147bf54758f1" returned: 0 in 0.508s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9f2a7138-d4a2-41ba-8ad7-400bafa4f9b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Lock "cinder-quobyte-1c709b8b-1d6b-4c90-88ce-147bf54758f1" released by "delete_volume" :: held 1.251s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:55:18 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-9f2a7138-d4a2-41ba-8ad7-400bafa4f9b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Created reservations ['a5843614-5d17-4109-b502-3cae5a9d2469', '33faeca4-fa05-48fa-9f4f-455bd49fb5c2', 'c4b60735-929d-4d15-951d-5c8520c93696', '4563fc2b-acf7-409d-bd61-e4bc1b3aa7c3'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:55:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9f2a7138-d4a2-41ba-8ad7-400bafa4f9b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:55:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9f2a7138-d4a2-41ba-8ad7-400bafa4f9b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:55:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-9f2a7138-d4a2-41ba-8ad7-400bafa4f9b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:55:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-9f2a7138-d4a2-41ba-8ad7-400bafa4f9b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:55:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9f2a7138-d4a2-41ba-8ad7-400bafa4f9b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:55:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f2a7138-d4a2-41ba-8ad7-400bafa4f9b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:18 devstack sudo[86977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:55:18 devstack sudo[86977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:18 devstack sudo[86974]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_7la6qhab" returned: 1 in 0.699s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_7la6qhab' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 12:55:18 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_7la6qhab, size 20.69 MB, duration 1.00 sec {{(pid=80839) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Nov 19 12:55:18 devstack cinder-volume[80839]: INFO cinder.image.image_utils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] Image download 20.69 MB at 20.69 MB/s
Nov 19 12:55:18 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5af2ad-0517-4ba6-8b49-7931dbb90aa6]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:55:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_7la6qhab {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:18 devstack sudo[86981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_7la6qhab
Nov 19 12:55:18 devstack sudo[86981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:18 devstack sudo[86977]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f2a7138-d4a2-41ba-8ad7-400bafa4f9b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.559s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:19 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-9f2a7138-d4a2-41ba-8ad7-400bafa4f9b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:55:19 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-9f2a7138-d4a2-41ba-8ad7-400bafa4f9b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Deleted volume successfully.
Nov 19 12:55:19 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9f2a7138-d4a2-41ba-8ad7-400bafa4f9b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1303420955 None] Lock "cinder-1c709b8b-1d6b-4c90-88ce-147bf54758f1-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:55:19 devstack sudo[86981]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_7la6qhab" returned: 0 in 0.673s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:19 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] 5d491c17-c417-4a2b-886e-ad2958917626 was qcow2, converting to raw {{(pid=80839) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Nov 19 12:55:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -S 0 -f qcow2 /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_7la6qhab /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:19 devstack sudo[86987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -S 0 -f qcow2 /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_7la6qhab /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974
Nov 19 12:55:19 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:21 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -S 0 -f qcow2 /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_7la6qhab /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974" returned: 0 in 2.001s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:21 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_7la6qhab, size 112.00 MB, duration 2.00 sec, destination /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974 {{(pid=80839) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 19 12:55:21 devstack cinder-volume[80839]: INFO cinder.image.image_utils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] Converted 112.00 MB image at 55.93 MB/s
Nov 19 12:55:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:21 devstack sudo[87003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974 1G
Nov 19 12:55:21 devstack sudo[87003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:22 devstack sudo[87003]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974 1G" returned: 0 in 0.606s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:22 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[21977b8e-d86a-4f19-8bf6-6161e4e4a1d5]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:55:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:22 devstack sudo[87008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974
Nov 19 12:55:22 devstack sudo[87008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:22 devstack sudo[87008]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974" returned: 0 in 0.811s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:23 devstack sudo[87013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974
Nov 19 12:55:23 devstack sudo[87013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:23 devstack sudo[87013]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974" returned: 1 in 0.781s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 12:55:23 devstack cinder-volume[80839]: DEBUG cinder.volume.volume_utils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] Downloaded image 5d491c17-c417-4a2b-886e-ad2958917626 ((None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}])) to volume 1852d1f9-6022-4da9-aec1-3cc6ec90b974 successfully. {{(pid=80839) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Nov 19 12:55:23 devstack cinder-volume[80839]: DEBUG cinder.volume.volume_utils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] Marking volume 1852d1f9-6022-4da9-aec1-3cc6ec90b974 as bootable. {{(pid=80839) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Nov 19 12:55:23 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] Creating volume glance metadata for volume 1852d1f9-6022-4da9-aec1-3cc6ec90b974 backed by image 5d491c17-c417-4a2b-886e-ad2958917626 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=80839) _refresh_volume_glance_meta /opt/stack/cinder/cinder/volume/manager.py:5376}}
Nov 19 12:55:23 devstack cinder-volume[80839]: DEBUG cinder.compute.nova [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] Creating Keystone auth plugin from conf {{(pid=80839) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}}
Nov 19 12:55:23 devstack cinder-volume[80839]: DEBUG novaclient.v2.client [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://192.168.122.161/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "OpenStack-API-Version: compute 2.93" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}cb24bb9a332db8dff7c823e84910e88e2532caa6d4b93a29905c9c6ea99a8e45" -H "X-OpenStack-Nova-API-Version: 2.93" -H "X-OpenStack-Request-ID: req-a2a80417-ed90-465c-8297-a9ccb6a1c931" -H "X-Service-Token: {SHA256}1f0174f9b0f60cf9a3d7710d63859e59873ca2cece540fcc26e1f8498e46b9e9" -d '{"events": [{"name": "volume-reimaged", "server_uuid": "bbc7a337-a13d-453d-b865-1675ef3e9f96", "tag": "1852d1f9-6022-4da9-aec1-3cc6ec90b974"}]}' {{(pid=80839) _http_log_request /opt/stack/data/venv/lib/python3.10/site-packages/keystoneauth1/session.py:572}}
Nov 19 12:55:24 devstack cinder-volume[80839]: DEBUG novaclient.v2.client [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 19 Nov 2025 11:55:23 GMT OpenStack-API-Version: compute 2.93 Server: Apache/2.4.52 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.93 x-compute-request-id: req-f8d0bc69-ac85-4a03-9c26-aa8f27655117 x-openstack-request-id: req-f8d0bc69-ac85-4a03-9c26-aa8f27655117 {{(pid=80839) _http_log_response /opt/stack/data/venv/lib/python3.10/site-packages/keystoneauth1/session.py:613}}
Nov 19 12:55:24 devstack cinder-volume[80839]: DEBUG novaclient.v2.client [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] RESP BODY: {"events": [{"name": "volume-reimaged", "server_uuid": "bbc7a337-a13d-453d-b865-1675ef3e9f96", "tag": "1852d1f9-6022-4da9-aec1-3cc6ec90b974", "status": "completed", "code": 200}]} {{(pid=80839) _http_log_response /opt/stack/data/venv/lib/python3.10/site-packages/keystoneauth1/session.py:648}}
Nov 19 12:55:24 devstack cinder-volume[80839]: DEBUG novaclient.v2.client [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] POST call to compute for http://192.168.122.161/compute/v2.1/os-server-external-events used request id req-f8d0bc69-ac85-4a03-9c26-aa8f27655117 {{(pid=80839) request /opt/stack/data/venv/lib/python3.10/site-packages/keystoneauth1/session.py:1073}}
Nov 19 12:55:24 devstack cinder-volume[80839]: INFO cinder.compute.nova [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] Nova event response: {'name': 'volume-reimaged', 'server_uuid': 'bbc7a337-a13d-453d-b865-1675ef3e9f96', 'tag': '1852d1f9-6022-4da9-aec1-3cc6ec90b974', 'status': 'completed', 'code': 200}.
Nov 19 12:55:24 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-931000a3-c275-4bb9-a6e1-3d94a676500e tempest-ServerActionsV293TestJSON-1607053477 None] Re-imaged 5d491c17-c417-4a2b-886e-ad2958917626 to volume 1852d1f9-6022-4da9-aec1-3cc6ec90b974 successfully. {{(pid=80839) reimage /opt/stack/cinder/cinder/volume/manager.py:5419}}
Nov 19 12:55:25 devstack cinder-volume[80839]: DEBUG oslo_db.sqlalchemy.engines [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80839) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Nov 19 12:55:25 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:55:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Flow 'volume_create_manager' (94126344-2973-4310-bc17-b968b4360167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:55:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3644e72e-3088-4c4d-bc74-5af286fe9383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3644e72e-3088-4c4d-bc74-5af286fe9383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1272484015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3adc615a82a24a2e856e746a18907c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:55:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:55:26Z,use_quota=True,user_id='f6bee680b01e4248a73661fb35ba99b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5008d2d-3e33-4f7f-92fe-7c1c40c32b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5008d2d-3e33-4f7f-92fe-7c1c40c32b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b610b66c-c5ad-4b14-928c-0da54e9b3a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b610b66c-c5ad-4b14-928c-0da54e9b3a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8', 'volume_name': 'volume-e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8', 'volume_size': 2}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae14937-ee95-460a-905d-5262e593e670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae14937-ee95-460a-905d-5262e593e670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4efc0ca9-dbc7-462f-98c2-24dc0ab62d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:25 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Volume e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8', 'volume_size': 2}
Nov 19 12:55:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:55:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:55:25 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1272484015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3adc615a82a24a2e856e746a18907c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:55:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:55:26Z,use_quota=True,user_id='f6bee680b01e4248a73661fb35ba99b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:55:25 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Creating volume e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:55:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:55:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:55:25 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:55:25 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:55:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:55:25 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:55:25 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:55:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8 2147483648 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:26 devstack sudo[87060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8 2147483648
Nov 19 12:55:26 devstack sudo[87060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-4bc74fa7-5794-4118-a8f8-df1215edec3d tempest-ServerActionsV293TestJSON-1607053477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:55:27 devstack sudo[87060]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8 2147483648" returned: 0 in 1.133s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:27 devstack sudo[87084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8
Nov 19 12:55:27 devstack sudo[87084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:27 devstack sudo[87084]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8" returned: 0 in 0.510s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:27 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:55:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:55:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-4bc74fa7-5794-4118-a8f8-df1215edec3d tempest-ServerActionsV293TestJSON-1607053477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.571s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:55:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4efc0ca9-dbc7-462f-98c2-24dc0ab62d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8', 'volume_size': 2}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948c5d08-1678-4a85-ac6f-a0c1ab926cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:27 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Volume volume-e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8 (e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8): created successfully
Nov 19 12:55:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948c5d08-1678-4a85-ac6f-a0c1ab926cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Flow 'volume_create_manager' (94126344-2973-4310-bc17-b968b4360167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:55:27 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[955ff378-8bcc-4477-9c08-542e2cd8b5bd]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:55:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-4bc74fa7-5794-4118-a8f8-df1215edec3d tempest-ServerActionsV293TestJSON-1607053477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:27 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-85ff088a-241f-4dcc-9e9b-0815657b171f tempest-VolumesCloneNegativeTest-976108234 None] Created volume successfully.
Nov 19 12:55:27 devstack sudo[87087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974
Nov 19 12:55:27 devstack sudo[87087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:27 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b5322b01-5554-4537-b23b-91fde940adf2 tempest-VolumesCloneNegativeTest-976108234 None] Acquiring lock "cinder-e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:55:27 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b5322b01-5554-4537-b23b-91fde940adf2 tempest-VolumesCloneNegativeTest-976108234 None] Lock "cinder-e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:55:27 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b5322b01-5554-4537-b23b-91fde940adf2 tempest-VolumesCloneNegativeTest-976108234 None] Acquiring lock "cinder-quobyte-e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:55:27 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b5322b01-5554-4537-b23b-91fde940adf2 tempest-VolumesCloneNegativeTest-976108234 None] Lock "cinder-quobyte-e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8" acquired by "delete_volume" :: waited 0.017s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:55:27 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b51dd5c-85a7-4d19-a942-fbef40b4a193]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:55:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b5322b01-5554-4537-b23b-91fde940adf2 tempest-VolumesCloneNegativeTest-976108234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:28 devstack sudo[87089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8
Nov 19 12:55:28 devstack sudo[87089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:28 devstack sudo[87087]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-4bc74fa7-5794-4118-a8f8-df1215edec3d tempest-ServerActionsV293TestJSON-1607053477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974" returned: 0 in 0.665s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-4bc74fa7-5794-4118-a8f8-df1215edec3d tempest-ServerActionsV293TestJSON-1607053477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:28 devstack sudo[87093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974
Nov 19 12:55:28 devstack sudo[87093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:28 devstack sudo[87089]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b5322b01-5554-4537-b23b-91fde940adf2 tempest-VolumesCloneNegativeTest-976108234 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8" returned: 0 in 0.618s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b5322b01-5554-4537-b23b-91fde940adf2 tempest-VolumesCloneNegativeTest-976108234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:28 devstack sudo[87098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8
Nov 19 12:55:28 devstack sudo[87098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:28 devstack sudo[87093]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-4bc74fa7-5794-4118-a8f8-df1215edec3d tempest-ServerActionsV293TestJSON-1607053477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974" returned: 1 in 0.655s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-4bc74fa7-5794-4118-a8f8-df1215edec3d tempest-ServerActionsV293TestJSON-1607053477 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 12:55:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-4bc74fa7-5794-4118-a8f8-df1215edec3d tempest-ServerActionsV293TestJSON-1607053477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.365s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:55:29 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-4bc74fa7-5794-4118-a8f8-df1215edec3d tempest-ServerActionsV293TestJSON-1607053477 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a018c762-ef37-4690-bc45-41d1c23d880f', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 12:55:29 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-a2a80417-ed90-465c-8297-a9ccb6a1c931 req-4bc74fa7-5794-4118-a8f8-df1215edec3d tempest-ServerActionsV293TestJSON-1607053477 None] attachment_update completed successfully.
Nov 19 12:55:29 devstack sudo[87098]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b5322b01-5554-4537-b23b-91fde940adf2 tempest-VolumesCloneNegativeTest-976108234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8" returned: 0 in 0.560s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:29 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b5322b01-5554-4537-b23b-91fde940adf2 tempest-VolumesCloneNegativeTest-976108234 None] Lock "cinder-quobyte-e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8" released by "delete_volume" :: held 1.202s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:55:29 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-b5322b01-5554-4537-b23b-91fde940adf2 tempest-VolumesCloneNegativeTest-976108234 None] Created reservations ['b0b24b14-17c7-4583-8062-9fc714345479', '1c5a1e36-2974-48af-b7ca-421785645a0f', '9a83e042-5a2f-4678-94c4-1e241fd96fe6', 'c5bdced6-bd46-4167-bb6a-ddcfe8a4eb30'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:55:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b5322b01-5554-4537-b23b-91fde940adf2 tempest-VolumesCloneNegativeTest-976108234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:55:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b5322b01-5554-4537-b23b-91fde940adf2 tempest-VolumesCloneNegativeTest-976108234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:55:29 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b5322b01-5554-4537-b23b-91fde940adf2 tempest-VolumesCloneNegativeTest-976108234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:55:29 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b5322b01-5554-4537-b23b-91fde940adf2 tempest-VolumesCloneNegativeTest-976108234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:55:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b5322b01-5554-4537-b23b-91fde940adf2 tempest-VolumesCloneNegativeTest-976108234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:55:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b5322b01-5554-4537-b23b-91fde940adf2 tempest-VolumesCloneNegativeTest-976108234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:29 devstack sudo[87106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:55:29 devstack sudo[87106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:29 devstack sudo[87106]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b5322b01-5554-4537-b23b-91fde940adf2 tempest-VolumesCloneNegativeTest-976108234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.486s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:29 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-b5322b01-5554-4537-b23b-91fde940adf2 tempest-VolumesCloneNegativeTest-976108234 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:55:29 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-b5322b01-5554-4537-b23b-91fde940adf2 tempest-VolumesCloneNegativeTest-976108234 None] Deleted volume successfully.
Nov 19 12:55:29 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b5322b01-5554-4537-b23b-91fde940adf2 tempest-VolumesCloneNegativeTest-976108234 None] Lock "cinder-e58a9d8c-6727-4ad3-bcb2-15bf42fd1df8-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:55:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-833f8ed3-e25c-4e25-912e-1780d39944b0 req-f5635129-4f66-42d5-a939-11555dbcc71a tempest-TaggedAttachmentsTest-362033490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:55:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-833f8ed3-e25c-4e25-912e-1780d39944b0 req-f5635129-4f66-42d5-a939-11555dbcc71a tempest-TaggedAttachmentsTest-362033490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:55:31 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d4f9fa-8a39-45e4-9b5d-77e3d72b89ce]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:55:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-833f8ed3-e25c-4e25-912e-1780d39944b0 req-f5635129-4f66-42d5-a939-11555dbcc71a tempest-TaggedAttachmentsTest-362033490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-11dc3473-437c-4ce6-b880-6f27a70a3fae {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:31 devstack sudo[87218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-11dc3473-437c-4ce6-b880-6f27a70a3fae
Nov 19 12:55:31 devstack sudo[87218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:32 devstack sudo[87218]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-833f8ed3-e25c-4e25-912e-1780d39944b0 req-f5635129-4f66-42d5-a939-11555dbcc71a tempest-TaggedAttachmentsTest-362033490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-11dc3473-437c-4ce6-b880-6f27a70a3fae" returned: 0 in 0.684s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-833f8ed3-e25c-4e25-912e-1780d39944b0 req-f5635129-4f66-42d5-a939-11555dbcc71a tempest-TaggedAttachmentsTest-362033490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.698s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:55:32 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-833f8ed3-e25c-4e25-912e-1780d39944b0 req-f5635129-4f66-42d5-a939-11555dbcc71a tempest-TaggedAttachmentsTest-362033490 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-11dc3473-437c-4ce6-b880-6f27a70a3fae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5ce2ed58-1156-46a6-ba2d-4b186be385c7', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 12:55:32 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-833f8ed3-e25c-4e25-912e-1780d39944b0 req-f5635129-4f66-42d5-a939-11555dbcc71a tempest-TaggedAttachmentsTest-362033490 None] attachment_update completed successfully.
Nov 19 12:55:40 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-acd32b18-9d2d-4c99-ba3e-bf33fafa213c req-9387284a-64fe-44ac-8e92-fce76ca30753 tempest-TaggedAttachmentsTest-362033490 None] Terminate volume connection completed successfully.
Nov 19 12:55:40 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-acd32b18-9d2d-4c99-ba3e-bf33fafa213c req-9387284a-64fe-44ac-8e92-fce76ca30753 tempest-TaggedAttachmentsTest-362033490 None] Deleting attachment 5ce2ed58-1156-46a6-ba2d-4b186be385c7. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 12:55:50 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=70,cinder:UPDATE=77,cinder:INSERT=21,cinder:DELETE=5 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:55:50 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=54,cinder:UPDATE=54,cinder:DELETE=5,cinder:INSERT=19 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:55:54 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:55:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Flow 'volume_create_manager' (1223a2ff-4f8e-4184-9dea-2892cd25cc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:55:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1e4f81-7207-4852-b96f-06024fddd438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1e4f81-7207-4852-b96f-06024fddd438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-830574976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=521f1c2c-dc8d-4a14-9a29-ab622ffb8b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7907eb85ff974254831d0f11740ca6c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:55:55Z,use_quota=True,user_id='06c77640d71e4f0c849785bc501907b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d666fa0-e5ae-42ef-88c6-1ff5d13d9260),volume_type_id=6d666fa0-e5ae-42ef-88c6-1ff5d13d9260)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de274f52-c6c1-485c-b688-c1168c89a0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de274f52-c6c1-485c-b688-c1168c89a0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc0b258-f0f3-4f84-8d42-671b992c6f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc0b258-f0f3-4f84-8d42-671b992c6f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '521f1c2c-dc8d-4a14-9a29-ab622ffb8b55', 'volume_name': 'volume-521f1c2c-dc8d-4a14-9a29-ab622ffb8b55', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed9685ad-cfe6-4443-b6a5-78b74ec392bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed9685ad-cfe6-4443-b6a5-78b74ec392bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7d6762d-b370-4067-adc3-6fcfd533a057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:55 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Volume 521f1c2c-dc8d-4a14-9a29-ab622ffb8b55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-521f1c2c-dc8d-4a14-9a29-ab622ffb8b55', 'volume_size': 1}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-830574976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=521f1c2c-dc8d-4a14-9a29-ab622ffb8b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7907eb85ff974254831d0f11740ca6c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:55:55Z,use_quota=True,user_id='06c77640d71e4f0c849785bc501907b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d666fa0-e5ae-42ef-88c6-1ff5d13d9260),volume_type_id=6d666fa0-e5ae-42ef-88c6-1ff5d13d9260)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Creating volume 521f1c2c-dc8d-4a14-9a29-ab622ffb8b55 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:55:55 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-521f1c2c-dc8d-4a14-9a29-ab622ffb8b55 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:55 devstack sudo[87780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-521f1c2c-dc8d-4a14-9a29-ab622ffb8b55 1073741824
Nov 19 12:55:55 devstack sudo[87780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Flow 'volume_create_manager' (ffcf85e3-aab7-4cca-a063-9c1b46acf740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde26771-94b0-4ab2-96b2-a2c6b03294cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde26771-94b0-4ab2-96b2-a2c6b03294cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1908549003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd80195e-bb1b-4e27-8021-7fecc6801771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7907eb85ff974254831d0f11740ca6c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:55:55Z,use_quota=True,user_id='06c77640d71e4f0c849785bc501907b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb04cd55-40a7-478c-8c8d-8b39bc9263fd),volume_type_id=eb04cd55-40a7-478c-8c8d-8b39bc9263fd)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ce08edf-6f0c-4cf9-9180-cf6c47bb7ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ce08edf-6f0c-4cf9-9180-cf6c47bb7ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f6a750-6f0c-4d17-bf96-5fcb376268c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f6a750-6f0c-4d17-bf96-5fcb376268c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd80195e-bb1b-4e27-8021-7fecc6801771', 'volume_name': 'volume-dd80195e-bb1b-4e27-8021-7fecc6801771', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d7be2d-7476-401e-b1f2-074642b50574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d7be2d-7476-401e-b1f2-074642b50574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54366aa3-7311-4315-8e5f-59b8da82b597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:55 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Volume dd80195e-bb1b-4e27-8021-7fecc6801771: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd80195e-bb1b-4e27-8021-7fecc6801771', 'volume_size': 1}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Flow 'volume_create_manager' (b50f9f70-c935-4002-91ca-a225a8abf7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5844bc80-8888-480e-9275-d19edd637397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5844bc80-8888-480e-9275-d19edd637397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1323984382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ae9f79-302d-4d78-94a1-2d75153ef170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7907eb85ff974254831d0f11740ca6c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:55:56Z,use_quota=True,user_id='06c77640d71e4f0c849785bc501907b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e7f3089-6948-4035-abad-0e8c4d799a4f),volume_type_id=1e7f3089-6948-4035-abad-0e8c4d799a4f)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a822e67-0602-43f4-a443-0efcf3ae3f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a822e67-0602-43f4-a443-0efcf3ae3f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb23cb47-1235-41e4-8961-474e82219142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:55 devstack cinder-volume[80839]: DEBUG cinder.image.glance [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Creating Keystone auth plugin from conf {{(pid=80839) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Nov 19 12:55:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb23cb47-1235-41e4-8961-474e82219142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b7ae9f79-302d-4d78-94a1-2d75153ef170', 'volume_name': 'volume-b7ae9f79-302d-4d78-94a1-2d75153ef170', 'volume_size': 1, 'image_id': 'eafddcd6-434f-4d2b-998e-4dcf7ee38545', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eafddcd6-434f-4d2b-998e-4dcf7ee38545', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1660104990', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7907eb85ff974254831d0f11740ca6c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eafddcd6-434f-4d2b-998e-4dcf7ee38545', 'created_at': datetime.datetime(2025, 11, 19, 11, 55, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 19, 11, 55, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eafddcd6-434f-4d2b-998e-4dcf7ee38545/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbd13e00f70>}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40448f9-de12-4578-a57d-e224bcd12839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40448f9-de12-4578-a57d-e224bcd12839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa921cce-2cae-45d1-b4bc-281331a0a066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:56 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Volume b7ae9f79-302d-4d78-94a1-2d75153ef170: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b7ae9f79-302d-4d78-94a1-2d75153ef170', 'volume_size': 1, 'image_id': 'eafddcd6-434f-4d2b-998e-4dcf7ee38545', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eafddcd6-434f-4d2b-998e-4dcf7ee38545', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1660104990', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7907eb85ff974254831d0f11740ca6c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eafddcd6-434f-4d2b-998e-4dcf7ee38545', 'created_at': datetime.datetime(2025, 11, 19, 11, 55, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 19, 11, 55, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eafddcd6-434f-4d2b-998e-4dcf7ee38545/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbd13e00f70>}
Nov 19 12:55:56 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Cloning b7ae9f79-302d-4d78-94a1-2d75153ef170 from image eafddcd6-434f-4d2b-998e-4dcf7ee38545  at location (None, [{'url': 'file:///opt/stack/data/glance/images/eafddcd6-434f-4d2b-998e-4dcf7ee38545', 'metadata': {}}]). {{(pid=80839) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Nov 19 12:55:56 devstack sudo[87780]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-521f1c2c-dc8d-4a14-9a29-ab622ffb8b55 1073741824" returned: 0 in 1.220s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-521f1c2c-dc8d-4a14-9a29-ab622ffb8b55 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:56 devstack sudo[87787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-521f1c2c-dc8d-4a14-9a29-ab622ffb8b55
Nov 19 12:55:56 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:56 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-521f1c2c-dc8d-4a14-9a29-ab622ffb8b55" returned: 0 in 0.622s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:55:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:55:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.438s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:55:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1908549003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd80195e-bb1b-4e27-8021-7fecc6801771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7907eb85ff974254831d0f11740ca6c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:55:55Z,use_quota=True,user_id='06c77640d71e4f0c849785bc501907b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb04cd55-40a7-478c-8c8d-8b39bc9263fd),volume_type_id=eb04cd55-40a7-478c-8c8d-8b39bc9263fd)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:55:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Creating volume dd80195e-bb1b-4e27-8021-7fecc6801771 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:55:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:55:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:55:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:55:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:55:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:55:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:55:56 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:55:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dd80195e-bb1b-4e27-8021-7fecc6801771 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7d6762d-b370-4067-adc3-6fcfd533a057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-521f1c2c-dc8d-4a14-9a29-ab622ffb8b55', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8942b605-fd98-48ae-9735-866afe1ef131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:56 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Volume volume-521f1c2c-dc8d-4a14-9a29-ab622ffb8b55 (521f1c2c-dc8d-4a14-9a29-ab622ffb8b55): created successfully
Nov 19 12:55:56 devstack sudo[87791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dd80195e-bb1b-4e27-8021-7fecc6801771 1073741824
Nov 19 12:55:56 devstack sudo[87791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8942b605-fd98-48ae-9735-866afe1ef131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Flow 'volume_create_manager' (1223a2ff-4f8e-4184-9dea-2892cd25cc3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:55:56 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-87a8f928-58e0-4934-8675-14f5c02adcdf tempest-TestInstancesWithCinderVolumes-59473960 None] Created volume successfully.
Nov 19 12:55:57 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eafddcd6-434f-4d2b-998e-4dcf7ee38545_xf9lar2_devstack@QuobyteHD, size 20.69 MB, duration 1.53 sec {{(pid=80839) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Nov 19 12:55:57 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Image download 20.69 MB at 13.50 MB/s
Nov 19 12:55:57 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[723e55e9-a364-465e-9246-bb84cd8a12ad]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:55:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eafddcd6-434f-4d2b-998e-4dcf7ee38545_xf9lar2_devstack@QuobyteHD {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:57 devstack sudo[87822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eafddcd6-434f-4d2b-998e-4dcf7ee38545_xf9lar2_devstack@QuobyteHD
Nov 19 12:55:57 devstack sudo[87822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:57 devstack sudo[87791]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dd80195e-bb1b-4e27-8021-7fecc6801771 1073741824" returned: 0 in 0.925s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dd80195e-bb1b-4e27-8021-7fecc6801771 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:57 devstack sudo[87824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dd80195e-bb1b-4e27-8021-7fecc6801771
Nov 19 12:55:57 devstack sudo[87824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:58 devstack sudo[87822]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eafddcd6-434f-4d2b-998e-4dcf7ee38545_xf9lar2_devstack@QuobyteHD" returned: 0 in 0.692s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:58 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Temporary image eafddcd6-434f-4d2b-998e-4dcf7ee38545 is fetched for user 06c77640d71e4f0c849785bc501907b8. {{(pid=80839) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Nov 19 12:55:58 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2a6b62-9555-45cf-9a98-2b55e965f551]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:55:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eafddcd6-434f-4d2b-998e-4dcf7ee38545_xf9lar2_devstack@QuobyteHD {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:58 devstack sudo[87824]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dd80195e-bb1b-4e27-8021-7fecc6801771" returned: 0 in 0.615s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:58 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:55:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:55:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54366aa3-7311-4315-8e5f-59b8da82b597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd80195e-bb1b-4e27-8021-7fecc6801771', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f432e79-b29c-4e4d-8fca-bcd9389f7ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:55:58 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Volume volume-dd80195e-bb1b-4e27-8021-7fecc6801771 (dd80195e-bb1b-4e27-8021-7fecc6801771): created successfully
Nov 19 12:55:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f432e79-b29c-4e4d-8fca-bcd9389f7ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:55:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Flow 'volume_create_manager' (ffcf85e3-aab7-4cca-a063-9c1b46acf740) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:55:58 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-2683967a-8138-4624-8dba-ab7150a4d712 tempest-TestInstancesWithCinderVolumes-59473960 None] Created volume successfully.
Nov 19 12:55:58 devstack sudo[87830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eafddcd6-434f-4d2b-998e-4dcf7ee38545_xf9lar2_devstack@QuobyteHD
Nov 19 12:55:58 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:58 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eafddcd6-434f-4d2b-998e-4dcf7ee38545_xf9lar2_devstack@QuobyteHD" returned: 0 in 0.582s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:55:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:55:58 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1323984382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ae9f79-302d-4d78-94a1-2d75153ef170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7907eb85ff974254831d0f11740ca6c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:55:56Z,use_quota=True,user_id='06c77640d71e4f0c849785bc501907b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e7f3089-6948-4035-abad-0e8c4d799a4f),volume_type_id=1e7f3089-6948-4035-abad-0e8c4d799a4f)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:55:58 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Creating volume b7ae9f79-302d-4d78-94a1-2d75153ef170 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:55:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:55:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:55:58 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:55:58 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:55:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:55:58 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:55:58 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:55:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:59 devstack sudo[87835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170 1073741824
Nov 19 12:55:59 devstack sudo[87835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:55:59 devstack sudo[87835]: pam_unix(sudo:session): session closed for user root
Nov 19 12:55:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170 1073741824" returned: 0 in 0.597s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:55:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:55:59 devstack sudo[87840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170
Nov 19 12:55:59 devstack sudo[87840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:56:00 devstack sudo[87840]: pam_unix(sudo:session): session closed for user root
Nov 19 12:56:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170" returned: 0 in 0.540s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:56:00 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:56:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:56:00 devstack cinder-volume[80839]: DEBUG cinder.volume.volume_utils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Attempting download of eafddcd6-434f-4d2b-998e-4dcf7ee38545 ((None, [{'url': 'file:///opt/stack/data/glance/images/eafddcd6-434f-4d2b-998e-4dcf7ee38545', 'metadata': {}}])) to volume b7ae9f79-302d-4d78-94a1-2d75153ef170. {{(pid=80839) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Nov 19 12:56:00 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7b344f-bfb4-43a0-bf43-672c8ea986d9]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:56:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eafddcd6-434f-4d2b-998e-4dcf7ee38545_62exuifv {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:56:00 devstack sudo[87843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eafddcd6-434f-4d2b-998e-4dcf7ee38545_62exuifv
Nov 19 12:56:00 devstack sudo[87843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:56:00 devstack sudo[87843]: pam_unix(sudo:session): session closed for user root
Nov 19 12:56:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eafddcd6-434f-4d2b-998e-4dcf7ee38545_62exuifv" returned: 0 in 0.570s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:56:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eafddcd6-434f-4d2b-998e-4dcf7ee38545_62exuifv {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:56:00 devstack sudo[87847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eafddcd6-434f-4d2b-998e-4dcf7ee38545_62exuifv
Nov 19 12:56:00 devstack sudo[87847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:56:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d4dd3715-b21d-4859-b718-4465d021ce4e tempest-TaggedAttachmentsTest-362033490 None] Acquiring lock "cinder-11dc3473-437c-4ce6-b880-6f27a70a3fae-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:56:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d4dd3715-b21d-4859-b718-4465d021ce4e tempest-TaggedAttachmentsTest-362033490 None] Lock "cinder-11dc3473-437c-4ce6-b880-6f27a70a3fae-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:56:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d4dd3715-b21d-4859-b718-4465d021ce4e tempest-TaggedAttachmentsTest-362033490 None] Acquiring lock "cinder-quobyte-11dc3473-437c-4ce6-b880-6f27a70a3fae" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:56:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d4dd3715-b21d-4859-b718-4465d021ce4e tempest-TaggedAttachmentsTest-362033490 None] Lock "cinder-quobyte-11dc3473-437c-4ce6-b880-6f27a70a3fae" acquired by "delete_volume" :: waited 0.013s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:56:01 devstack sudo[87847]: pam_unix(sudo:session): session closed for user root
Nov 19 12:56:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eafddcd6-434f-4d2b-998e-4dcf7ee38545_62exuifv" returned: 1 in 0.616s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:56:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eafddcd6-434f-4d2b-998e-4dcf7ee38545_62exuifv' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 12:56:01 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ca429e-f522-4b68-98a3-43d02bf1216a]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:56:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eafddcd6-434f-4d2b-998e-4dcf7ee38545_xf9lar2_devstack@QuobyteHD {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:56:01 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe8b302-33ce-4c99-9f43-1eb7b7b289c7]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:56:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d4dd3715-b21d-4859-b718-4465d021ce4e tempest-TaggedAttachmentsTest-362033490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-11dc3473-437c-4ce6-b880-6f27a70a3fae {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:56:01 devstack sudo[87853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eafddcd6-434f-4d2b-998e-4dcf7ee38545_xf9lar2_devstack@QuobyteHD
Nov 19 12:56:01 devstack sudo[87853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:56:01 devstack sudo[87854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-11dc3473-437c-4ce6-b880-6f27a70a3fae
Nov 19 12:56:01 devstack sudo[87854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:56:01 devstack sudo[87854]: pam_unix(sudo:session): session closed for user root
Nov 19 12:56:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d4dd3715-b21d-4859-b718-4465d021ce4e tempest-TaggedAttachmentsTest-362033490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-11dc3473-437c-4ce6-b880-6f27a70a3fae" returned: 0 in 0.537s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:56:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d4dd3715-b21d-4859-b718-4465d021ce4e tempest-TaggedAttachmentsTest-362033490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-11dc3473-437c-4ce6-b880-6f27a70a3fae {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:56:01 devstack sudo[87853]: pam_unix(sudo:session): session closed for user root
Nov 19 12:56:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eafddcd6-434f-4d2b-998e-4dcf7ee38545_xf9lar2_devstack@QuobyteHD" returned: 0 in 0.559s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:56:01 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] eafddcd6-434f-4d2b-998e-4dcf7ee38545 was qcow2, converting to raw {{(pid=80839) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Nov 19 12:56:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eafddcd6-434f-4d2b-998e-4dcf7ee38545_xf9lar2_devstack@QuobyteHD /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:56:01 devstack sudo[87864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-11dc3473-437c-4ce6-b880-6f27a70a3fae
Nov 19 12:56:01 devstack sudo[87864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:56:02 devstack sudo[87865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eafddcd6-434f-4d2b-998e-4dcf7ee38545_xf9lar2_devstack@QuobyteHD /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170
Nov 19 12:56:02 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:56:02 devstack sudo[87864]: pam_unix(sudo:session): session closed for user root
Nov 19 12:56:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d4dd3715-b21d-4859-b718-4465d021ce4e tempest-TaggedAttachmentsTest-362033490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-11dc3473-437c-4ce6-b880-6f27a70a3fae" returned: 0 in 0.581s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:56:02 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d4dd3715-b21d-4859-b718-4465d021ce4e tempest-TaggedAttachmentsTest-362033490 None] Lock "cinder-quobyte-11dc3473-437c-4ce6-b880-6f27a70a3fae" released by "delete_volume" :: held 1.170s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:56:02 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-d4dd3715-b21d-4859-b718-4465d021ce4e tempest-TaggedAttachmentsTest-362033490 None] Created reservations ['6ec656d5-b070-4960-8fde-a4ce67b6be70', '304adb37-0171-4389-b806-bc90e12d4ba6', '6a442aae-aff3-4f9f-abba-15c1d3353255', '8799139e-3976-4063-a429-1a8b21803436'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:56:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d4dd3715-b21d-4859-b718-4465d021ce4e tempest-TaggedAttachmentsTest-362033490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:56:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d4dd3715-b21d-4859-b718-4465d021ce4e tempest-TaggedAttachmentsTest-362033490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:56:02 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d4dd3715-b21d-4859-b718-4465d021ce4e tempest-TaggedAttachmentsTest-362033490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:56:02 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d4dd3715-b21d-4859-b718-4465d021ce4e tempest-TaggedAttachmentsTest-362033490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:56:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d4dd3715-b21d-4859-b718-4465d021ce4e tempest-TaggedAttachmentsTest-362033490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:56:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d4dd3715-b21d-4859-b718-4465d021ce4e tempest-TaggedAttachmentsTest-362033490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:56:02 devstack sudo[87875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:56:02 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:56:02 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root
Nov 19 12:56:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eafddcd6-434f-4d2b-998e-4dcf7ee38545_xf9lar2_devstack@QuobyteHD /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170" returned: 0 in 0.914s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:56:02 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eafddcd6-434f-4d2b-998e-4dcf7ee38545_xf9lar2_devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170 {{(pid=80839) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 19 12:56:02 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Converted 112.00 MB image at 112.00 MB/s
Nov 19 12:56:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:56:02 devstack sudo[87877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170 1G
Nov 19 12:56:02 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:56:03 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root
Nov 19 12:56:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d4dd3715-b21d-4859-b718-4465d021ce4e tempest-TaggedAttachmentsTest-362033490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.500s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:56:03 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-d4dd3715-b21d-4859-b718-4465d021ce4e tempest-TaggedAttachmentsTest-362033490 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:56:03 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-d4dd3715-b21d-4859-b718-4465d021ce4e tempest-TaggedAttachmentsTest-362033490 None] Deleted volume successfully.
Nov 19 12:56:03 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d4dd3715-b21d-4859-b718-4465d021ce4e tempest-TaggedAttachmentsTest-362033490 None] Lock "cinder-11dc3473-437c-4ce6-b880-6f27a70a3fae-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:56:03 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root
Nov 19 12:56:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170 1G" returned: 0 in 0.516s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:56:03 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[225438a7-5a36-4b0f-b74d-79de13461578]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:56:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:56:03 devstack sudo[87883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170
Nov 19 12:56:03 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:56:04 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root
Nov 19 12:56:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170" returned: 0 in 0.602s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:56:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:56:04 devstack sudo[87887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170
Nov 19 12:56:04 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:56:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 12:56:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:56:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:56:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:56:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:56:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:56:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:56:04 devstack sudo[87889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:56:04 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:56:04 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root
Nov 19 12:56:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170" returned: 1 in 0.732s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:56:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 12:56:04 devstack cinder-volume[80839]: DEBUG cinder.volume.volume_utils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Downloaded image eafddcd6-434f-4d2b-998e-4dcf7ee38545 ((None, [{'url': 'file:///opt/stack/data/glance/images/eafddcd6-434f-4d2b-998e-4dcf7ee38545', 'metadata': {}}])) to volume b7ae9f79-302d-4d78-94a1-2d75153ef170 successfully. {{(pid=80839) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Nov 19 12:56:04 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Temporary image eafddcd6-434f-4d2b-998e-4dcf7ee38545 for user 06c77640d71e4f0c849785bc501907b8 is deleted. {{(pid=80839) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Nov 19 12:56:04 devstack cinder-volume[80839]: DEBUG cinder.volume.volume_utils [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Marking volume b7ae9f79-302d-4d78-94a1-2d75153ef170 as bootable. {{(pid=80839) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Nov 19 12:56:04 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Copying metadata from image eafddcd6-434f-4d2b-998e-4dcf7ee38545 to b7ae9f79-302d-4d78-94a1-2d75153ef170. {{(pid=80839) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 19 12:56:04 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Creating volume glance metadata for volume b7ae9f79-302d-4d78-94a1-2d75153ef170 backed by image eafddcd6-434f-4d2b-998e-4dcf7ee38545 with: {'image_id': 'eafddcd6-434f-4d2b-998e-4dcf7ee38545', 'image_name': 'tempest-scenario-img--1660104990', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=80839) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 19 12:56:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa921cce-2cae-45d1-b4bc-281331a0a066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7ae9f79-302d-4d78-94a1-2d75153ef170', 'volume_size': 1, 'image_id': 'eafddcd6-434f-4d2b-998e-4dcf7ee38545', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eafddcd6-434f-4d2b-998e-4dcf7ee38545', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1660104990', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7907eb85ff974254831d0f11740ca6c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eafddcd6-434f-4d2b-998e-4dcf7ee38545', 'created_at': datetime.datetime(2025, 11, 19, 11, 55, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 19, 11, 55, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eafddcd6-434f-4d2b-998e-4dcf7ee38545/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbd13e00f70>}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:56:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc40405-06ef-426a-95dd-6803ed1b2f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:56:04 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Volume volume-b7ae9f79-302d-4d78-94a1-2d75153ef170 (b7ae9f79-302d-4d78-94a1-2d75153ef170): created successfully
Nov 19 12:56:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc40405-06ef-426a-95dd-6803ed1b2f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:56:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Flow 'volume_create_manager' (b50f9f70-c935-4002-91ca-a225a8abf7f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:56:04 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-4cc870d4-4660-4430-bc65-f70ce6dadf7d tempest-TestInstancesWithCinderVolumes-59473960 None] Created volume successfully.
Nov 19 12:56:05 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root
Nov 19 12:56:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.648s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:56:05 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:56:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-4ade0c5a-c935-4d2f-b6e1-f8f62a03299a req-25f425f5-041f-4e37-b6b3-ecb2e17f4e04 tempest-TestInstancesWithCinderVolumes-59473960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:56:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-4ade0c5a-c935-4d2f-b6e1-f8f62a03299a req-25f425f5-041f-4e37-b6b3-ecb2e17f4e04 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:56:12 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd8186f-acf8-4cfd-bf2a-7548fbef308d]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:56:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-4ade0c5a-c935-4d2f-b6e1-f8f62a03299a req-25f425f5-041f-4e37-b6b3-ecb2e17f4e04 tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:56:12 devstack sudo[87923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170
Nov 19 12:56:12 devstack sudo[87923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:56:13 devstack sudo[87923]: pam_unix(sudo:session): session closed for user root
Nov 19 12:56:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-4ade0c5a-c935-4d2f-b6e1-f8f62a03299a req-25f425f5-041f-4e37-b6b3-ecb2e17f4e04 tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170" returned: 0 in 0.681s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:56:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-4ade0c5a-c935-4d2f-b6e1-f8f62a03299a req-25f425f5-041f-4e37-b6b3-ecb2e17f4e04 tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:56:13 devstack sudo[87927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170
Nov 19 12:56:13 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:56:13 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root
Nov 19 12:56:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-4ade0c5a-c935-4d2f-b6e1-f8f62a03299a req-25f425f5-041f-4e37-b6b3-ecb2e17f4e04 tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170" returned: 1 in 0.649s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:56:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-4ade0c5a-c935-4d2f-b6e1-f8f62a03299a req-25f425f5-041f-4e37-b6b3-ecb2e17f4e04 tempest-TestInstancesWithCinderVolumes-59473960 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 12:56:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-4ade0c5a-c935-4d2f-b6e1-f8f62a03299a req-25f425f5-041f-4e37-b6b3-ecb2e17f4e04 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.364s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:56:14 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-4ade0c5a-c935-4d2f-b6e1-f8f62a03299a req-25f425f5-041f-4e37-b6b3-ecb2e17f4e04 tempest-TestInstancesWithCinderVolumes-59473960 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-b7ae9f79-302d-4d78-94a1-2d75153ef170', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91f5ebfb-620d-4109-a2dd-ebc4060c0e4d', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 12:56:14 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-4ade0c5a-c935-4d2f-b6e1-f8f62a03299a req-25f425f5-041f-4e37-b6b3-ecb2e17f4e04 tempest-TestInstancesWithCinderVolumes-59473960 None] attachment_update completed successfully.
Nov 19 12:56:24 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=15,cinder:UPDATE=19,cinder:DELETE=3,cinder:INSERT=7 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:56:24 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=23,cinder:UPDATE=15,cinder:INSERT=6,cinder:DELETE=1 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:56:47 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:56:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Flow 'volume_create_manager' (3a3e0c76-596a-41cb-91d9-0a7654870312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:56:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (147da488-03b8-4fe2-a4bb-94c42b1679d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:56:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (147da488-03b8-4fe2-a4bb-94c42b1679d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1845629026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35de9b51-3942-4bf7-b6b2-d01abc591daf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451155a443c34da38d5de9afd6b76741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:56:48Z,use_quota=True,user_id='a899fefa46a6435f89155fe786a7fd48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:56:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0683944b-9c1f-4635-80df-dc7ed54a0c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:56:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0683944b-9c1f-4635-80df-dc7ed54a0c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:56:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d494a37c-4919-4093-b055-e21878060d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:56:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d494a37c-4919-4093-b055-e21878060d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35de9b51-3942-4bf7-b6b2-d01abc591daf', 'volume_name': 'volume-35de9b51-3942-4bf7-b6b2-d01abc591daf', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:56:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d258df-1b47-40ce-a829-d01281fac680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:56:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d258df-1b47-40ce-a829-d01281fac680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:56:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3028f6d4-dada-4952-856e-50093fa84ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:56:47 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Volume 35de9b51-3942-4bf7-b6b2-d01abc591daf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35de9b51-3942-4bf7-b6b2-d01abc591daf', 'volume_size': 1}
Nov 19 12:56:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:56:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:56:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1845629026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35de9b51-3942-4bf7-b6b2-d01abc591daf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451155a443c34da38d5de9afd6b76741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:56:48Z,use_quota=True,user_id='a899fefa46a6435f89155fe786a7fd48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:56:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Creating volume 35de9b51-3942-4bf7-b6b2-d01abc591daf {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:56:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:56:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:56:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:56:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:56:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:56:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:56:47 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:56:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-35de9b51-3942-4bf7-b6b2-d01abc591daf 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:56:47 devstack sudo[88297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-35de9b51-3942-4bf7-b6b2-d01abc591daf 1073741824
Nov 19 12:56:47 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:56:48 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root
Nov 19 12:56:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-35de9b51-3942-4bf7-b6b2-d01abc591daf 1073741824" returned: 0 in 0.559s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:56:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-35de9b51-3942-4bf7-b6b2-d01abc591daf {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:56:48 devstack sudo[88302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-35de9b51-3942-4bf7-b6b2-d01abc591daf
Nov 19 12:56:48 devstack sudo[88302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:56:48 devstack sudo[88302]: pam_unix(sudo:session): session closed for user root
Nov 19 12:56:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-35de9b51-3942-4bf7-b6b2-d01abc591daf" returned: 0 in 0.535s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:56:48 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:56:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:56:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3028f6d4-dada-4952-856e-50093fa84ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35de9b51-3942-4bf7-b6b2-d01abc591daf', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:56:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (636f4b31-73d7-487d-9fc9-e7e64211afde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:56:49 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Volume volume-35de9b51-3942-4bf7-b6b2-d01abc591daf (35de9b51-3942-4bf7-b6b2-d01abc591daf): created successfully
Nov 19 12:56:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (636f4b31-73d7-487d-9fc9-e7e64211afde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:56:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Flow 'volume_create_manager' (3a3e0c76-596a-41cb-91d9-0a7654870312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:56:49 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-b534f604-0c09-4053-9d85-4f7cad92bdcb tempest-ServerRescueNegativeTestJSON-79025645 None] Created volume successfully.
Nov 19 12:56:50 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:56:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Flow 'volume_create_manager' (5e6fa83f-49a0-49aa-99af-311def85c259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:56:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66895f2e-b721-47ca-9c8d-89b88d4bf6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:56:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66895f2e-b721-47ca-9c8d-89b88d4bf6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherB-volume-790137375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ffc91b-f5a3-46d2-8a24-d49a06d69b32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd278f214200428db843fc3a009a288e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:56:50Z,use_quota=True,user_id='f9ff0f5508d54a1eaa9219f8015cba41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:56:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c336b9-8e08-4839-888a-f060f6bf9e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:56:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c336b9-8e08-4839-888a-f060f6bf9e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:56:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c661dc-575d-4164-8c8f-dbf0152f222f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:56:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c661dc-575d-4164-8c8f-dbf0152f222f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5ffc91b-f5a3-46d2-8a24-d49a06d69b32', 'volume_name': 'volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:56:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0ebb2d-fb57-46fa-a428-67d9d928dc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:56:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0ebb2d-fb57-46fa-a428-67d9d928dc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:56:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7adba54b-0d89-4267-8348-bcef4afe51c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:56:50 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Volume d5ffc91b-f5a3-46d2-8a24-d49a06d69b32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32', 'volume_size': 1}
Nov 19 12:56:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:56:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:56:50 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherB-volume-790137375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ffc91b-f5a3-46d2-8a24-d49a06d69b32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd278f214200428db843fc3a009a288e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:56:50Z,use_quota=True,user_id='f9ff0f5508d54a1eaa9219f8015cba41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:56:50 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Creating volume d5ffc91b-f5a3-46d2-8a24-d49a06d69b32 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:56:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:56:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:56:50 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:56:50 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:56:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:56:50 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:56:50 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:56:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:56:50 devstack sudo[88307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32 1073741824
Nov 19 12:56:50 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:56:51 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root
Nov 19 12:56:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32 1073741824" returned: 0 in 0.647s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:56:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:56:51 devstack sudo[88312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32
Nov 19 12:56:51 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:56:51 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root
Nov 19 12:56:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32" returned: 0 in 0.564s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:56:51 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:56:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:56:51 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7adba54b-0d89-4267-8348-bcef4afe51c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:56:51 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b58d9064-1016-4f3b-974f-61c22b58c35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:56:51 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Volume volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32 (d5ffc91b-f5a3-46d2-8a24-d49a06d69b32): created successfully
Nov 19 12:56:51 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b58d9064-1016-4f3b-974f-61c22b58c35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:56:51 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Flow 'volume_create_manager' (5e6fa83f-49a0-49aa-99af-311def85c259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:56:51 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-5049e163-e394-4d35-8e74-67b0a7b0442c tempest-ServerActionsTestOtherB-1049727321 None] Created volume successfully.
Nov 19 12:56:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-0129a408-3a07-4f90-9b42-9a5a915a02ae req-78a4f7f8-1eac-4413-94ec-7305a639064d tempest-ServerActionsTestOtherB-1049727321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:56:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-0129a408-3a07-4f90-9b42-9a5a915a02ae req-78a4f7f8-1eac-4413-94ec-7305a639064d tempest-ServerActionsTestOtherB-1049727321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:56:55 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[383929e6-8251-400e-a26f-de4bb7b48c43]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:56:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-0129a408-3a07-4f90-9b42-9a5a915a02ae req-78a4f7f8-1eac-4413-94ec-7305a639064d tempest-ServerActionsTestOtherB-1049727321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:56:55 devstack sudo[88390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32
Nov 19 12:56:55 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:56:56 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root
Nov 19 12:56:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-0129a408-3a07-4f90-9b42-9a5a915a02ae req-78a4f7f8-1eac-4413-94ec-7305a639064d tempest-ServerActionsTestOtherB-1049727321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32" returned: 0 in 0.681s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:56:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-0129a408-3a07-4f90-9b42-9a5a915a02ae req-78a4f7f8-1eac-4413-94ec-7305a639064d tempest-ServerActionsTestOtherB-1049727321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.699s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:56:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-0129a408-3a07-4f90-9b42-9a5a915a02ae req-78a4f7f8-1eac-4413-94ec-7305a639064d tempest-ServerActionsTestOtherB-1049727321 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '48bb6539-4f2c-4bfb-a38b-77cd66e18786', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 12:56:56 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-0129a408-3a07-4f90-9b42-9a5a915a02ae req-78a4f7f8-1eac-4413-94ec-7305a639064d tempest-ServerActionsTestOtherB-1049727321 None] attachment_update completed successfully.
Nov 19 12:57:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 12:57:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:57:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:57:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:57:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:57:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:57:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:57:04 devstack sudo[88479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:57:04 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:57:06 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root
Nov 19 12:57:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 1.663s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:57:06 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:57:06 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=8,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:57:06 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:UPDATE=5,cinder:SELECT=7,cinder:DELETE=1 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:57:07 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-cfd9c1d0-64de-4e5d-81f5-24f5a4ae1e6a req-b96c85cf-e8b7-4280-b95f-d1a7a5b11b52 tempest-ServerActionsV293TestJSON-1607053477 None] Terminate volume connection completed successfully.
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-cfd9c1d0-64de-4e5d-81f5-24f5a4ae1e6a req-b96c85cf-e8b7-4280-b95f-d1a7a5b11b52 tempest-ServerActionsV293TestJSON-1607053477 None] Deleting attachment a018c762-ef37-4690-bc45-41d1c23d880f. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Flow 'volume_create_manager' (59714e99-407f-4a06-9370-cb99c35f52a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f83e0a-7cda-419a-9099-31139b3b4317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f83e0a-7cda-419a-9099-31139b3b4317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-567235279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4513d94-d757-4df6-8886-a8c37ae19bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451155a443c34da38d5de9afd6b76741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:57:07Z,use_quota=True,user_id='a899fefa46a6435f89155fe786a7fd48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302ccd43-2189-415b-afaf-b974fec96c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302ccd43-2189-415b-afaf-b974fec96c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d688e6e7-966d-4e57-8e4d-d86bd0109588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d688e6e7-966d-4e57-8e4d-d86bd0109588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4513d94-d757-4df6-8886-a8c37ae19bc3', 'volume_name': 'volume-d4513d94-d757-4df6-8886-a8c37ae19bc3', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c68ac12-64ec-4f48-a28a-14db6ebcdfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c68ac12-64ec-4f48-a28a-14db6ebcdfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9cdfd7b-7249-49cc-9c5a-571fade887aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:57:07 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Volume d4513d94-d757-4df6-8886-a8c37ae19bc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4513d94-d757-4df6-8886-a8c37ae19bc3', 'volume_size': 1}
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-567235279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4513d94-d757-4df6-8886-a8c37ae19bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451155a443c34da38d5de9afd6b76741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:57:07Z,use_quota=True,user_id='a899fefa46a6435f89155fe786a7fd48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Creating volume d4513d94-d757-4df6-8886-a8c37ae19bc3 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:57:07 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d4513d94-d757-4df6-8886-a8c37ae19bc3 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:57:07 devstack sudo[88546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d4513d94-d757-4df6-8886-a8c37ae19bc3 1073741824
Nov 19 12:57:07 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-cfd9c1d0-64de-4e5d-81f5-24f5a4ae1e6a req-f91972e4-dc06-4f9d-8d0c-cb163f79cdf5 tempest-ServerActionsV293TestJSON-1607053477 None] Acquiring lock "cinder-1852d1f9-6022-4da9-aec1-3cc6ec90b974-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-cfd9c1d0-64de-4e5d-81f5-24f5a4ae1e6a req-f91972e4-dc06-4f9d-8d0c-cb163f79cdf5 tempest-ServerActionsV293TestJSON-1607053477 None] Lock "cinder-1852d1f9-6022-4da9-aec1-3cc6ec90b974-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-cfd9c1d0-64de-4e5d-81f5-24f5a4ae1e6a req-f91972e4-dc06-4f9d-8d0c-cb163f79cdf5 tempest-ServerActionsV293TestJSON-1607053477 None] Acquiring lock "cinder-quobyte-1852d1f9-6022-4da9-aec1-3cc6ec90b974" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-cfd9c1d0-64de-4e5d-81f5-24f5a4ae1e6a req-f91972e4-dc06-4f9d-8d0c-cb163f79cdf5 tempest-ServerActionsV293TestJSON-1607053477 None] Lock "cinder-quobyte-1852d1f9-6022-4da9-aec1-3cc6ec90b974" acquired by "delete_volume" :: waited 0.015s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4551eb-2048-4626-8514-8dcd635cdd19]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:57:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-cfd9c1d0-64de-4e5d-81f5-24f5a4ae1e6a req-f91972e4-dc06-4f9d-8d0c-cb163f79cdf5 tempest-ServerActionsV293TestJSON-1607053477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:57:07 devstack sudo[88548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974
Nov 19 12:57:07 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:57:08 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root
Nov 19 12:57:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d4513d94-d757-4df6-8886-a8c37ae19bc3 1073741824" returned: 0 in 1.116s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:57:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d4513d94-d757-4df6-8886-a8c37ae19bc3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:57:08 devstack sudo[88555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d4513d94-d757-4df6-8886-a8c37ae19bc3
Nov 19 12:57:08 devstack sudo[88555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:57:08 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root
Nov 19 12:57:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-cfd9c1d0-64de-4e5d-81f5-24f5a4ae1e6a req-f91972e4-dc06-4f9d-8d0c-cb163f79cdf5 tempest-ServerActionsV293TestJSON-1607053477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974" returned: 0 in 0.830s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:57:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-cfd9c1d0-64de-4e5d-81f5-24f5a4ae1e6a req-f91972e4-dc06-4f9d-8d0c-cb163f79cdf5 tempest-ServerActionsV293TestJSON-1607053477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:57:08 devstack sudo[88557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974
Nov 19 12:57:08 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:57:09 devstack sudo[88555]: pam_unix(sudo:session): session closed for user root
Nov 19 12:57:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d4513d94-d757-4df6-8886-a8c37ae19bc3" returned: 0 in 0.739s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:57:09 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:57:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:57:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9cdfd7b-7249-49cc-9c5a-571fade887aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4513d94-d757-4df6-8886-a8c37ae19bc3', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:57:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73366d8-d3d7-4e07-9d4b-a236d3a3ea9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:57:09 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Volume volume-d4513d94-d757-4df6-8886-a8c37ae19bc3 (d4513d94-d757-4df6-8886-a8c37ae19bc3): created successfully
Nov 19 12:57:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73366d8-d3d7-4e07-9d4b-a236d3a3ea9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:57:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Flow 'volume_create_manager' (59714e99-407f-4a06-9370-cb99c35f52a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:57:09 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-241fc13f-68dc-43dc-9fa0-cb401d7f26a3 tempest-ServerRescueNegativeTestJSON-79025645 None] Created volume successfully.
Nov 19 12:57:09 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root
Nov 19 12:57:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-cfd9c1d0-64de-4e5d-81f5-24f5a4ae1e6a req-f91972e4-dc06-4f9d-8d0c-cb163f79cdf5 tempest-ServerActionsV293TestJSON-1607053477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974" returned: 1 in 1.334s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:57:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-cfd9c1d0-64de-4e5d-81f5-24f5a4ae1e6a req-f91972e4-dc06-4f9d-8d0c-cb163f79cdf5 tempest-ServerActionsV293TestJSON-1607053477 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 12:57:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-cfd9c1d0-64de-4e5d-81f5-24f5a4ae1e6a req-f91972e4-dc06-4f9d-8d0c-cb163f79cdf5 tempest-ServerActionsV293TestJSON-1607053477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:57:09 devstack sudo[88564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974
Nov 19 12:57:09 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:57:10 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root
Nov 19 12:57:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-cfd9c1d0-64de-4e5d-81f5-24f5a4ae1e6a req-f91972e4-dc06-4f9d-8d0c-cb163f79cdf5 tempest-ServerActionsV293TestJSON-1607053477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1852d1f9-6022-4da9-aec1-3cc6ec90b974" returned: 0 in 0.880s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:57:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-cfd9c1d0-64de-4e5d-81f5-24f5a4ae1e6a req-f91972e4-dc06-4f9d-8d0c-cb163f79cdf5 tempest-ServerActionsV293TestJSON-1607053477 None] Lock "cinder-quobyte-1852d1f9-6022-4da9-aec1-3cc6ec90b974" released by "delete_volume" :: held 3.126s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:57:10 devstack cinder-volume[80839]: DEBUG cinder.quota [req-cfd9c1d0-64de-4e5d-81f5-24f5a4ae1e6a req-f91972e4-dc06-4f9d-8d0c-cb163f79cdf5 tempest-ServerActionsV293TestJSON-1607053477 None] Created reservations ['e4a12e69-a85e-47dd-811a-0a4e4e884439', '56dbf25a-a583-4df1-964d-8007422489aa', '5ed6d427-31d5-4590-b457-84f9f4604e51', 'c685f3b3-d0a2-4d91-ac10-df147e987325'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:57:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-cfd9c1d0-64de-4e5d-81f5-24f5a4ae1e6a req-f91972e4-dc06-4f9d-8d0c-cb163f79cdf5 tempest-ServerActionsV293TestJSON-1607053477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:57:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-cfd9c1d0-64de-4e5d-81f5-24f5a4ae1e6a req-f91972e4-dc06-4f9d-8d0c-cb163f79cdf5 tempest-ServerActionsV293TestJSON-1607053477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:57:10 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [req-cfd9c1d0-64de-4e5d-81f5-24f5a4ae1e6a req-f91972e4-dc06-4f9d-8d0c-cb163f79cdf5 tempest-ServerActionsV293TestJSON-1607053477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:57:10 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [req-cfd9c1d0-64de-4e5d-81f5-24f5a4ae1e6a req-f91972e4-dc06-4f9d-8d0c-cb163f79cdf5 tempest-ServerActionsV293TestJSON-1607053477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:57:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-cfd9c1d0-64de-4e5d-81f5-24f5a4ae1e6a req-f91972e4-dc06-4f9d-8d0c-cb163f79cdf5 tempest-ServerActionsV293TestJSON-1607053477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:57:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-cfd9c1d0-64de-4e5d-81f5-24f5a4ae1e6a req-f91972e4-dc06-4f9d-8d0c-cb163f79cdf5 tempest-ServerActionsV293TestJSON-1607053477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:57:10 devstack sudo[88567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:57:10 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:57:11 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root
Nov 19 12:57:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-cfd9c1d0-64de-4e5d-81f5-24f5a4ae1e6a req-f91972e4-dc06-4f9d-8d0c-cb163f79cdf5 tempest-ServerActionsV293TestJSON-1607053477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.611s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:57:11 devstack cinder-volume[80839]: DEBUG cinder.manager [req-cfd9c1d0-64de-4e5d-81f5-24f5a4ae1e6a req-f91972e4-dc06-4f9d-8d0c-cb163f79cdf5 tempest-ServerActionsV293TestJSON-1607053477 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:57:11 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-cfd9c1d0-64de-4e5d-81f5-24f5a4ae1e6a req-f91972e4-dc06-4f9d-8d0c-cb163f79cdf5 tempest-ServerActionsV293TestJSON-1607053477 None] Deleted volume successfully.
Nov 19 12:57:11 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-cfd9c1d0-64de-4e5d-81f5-24f5a4ae1e6a req-f91972e4-dc06-4f9d-8d0c-cb163f79cdf5 tempest-ServerActionsV293TestJSON-1607053477 None] Lock "cinder-1852d1f9-6022-4da9-aec1-3cc6ec90b974-delete_volume" released by "delete_volume" :: held 3.903s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:57:13 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-142b0608-5104-49d8-99eb-49ee76d4e79c req-6fe87b78-78da-4b6c-9a11-b0540fd7ff85 tempest-ServerActionsTestOtherB-1049727321 None] Terminate volume connection completed successfully.
Nov 19 12:57:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-142b0608-5104-49d8-99eb-49ee76d4e79c req-6fe87b78-78da-4b6c-9a11-b0540fd7ff85 tempest-ServerActionsTestOtherB-1049727321 None] Deleting attachment 48bb6539-4f2c-4bfb-a38b-77cd66e18786. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 12:57:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-142b0608-5104-49d8-99eb-49ee76d4e79c req-1272301d-6c55-49e5-97f0-73e3e1aff51b tempest-ServerActionsTestOtherB-1049727321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:57:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-142b0608-5104-49d8-99eb-49ee76d4e79c req-1272301d-6c55-49e5-97f0-73e3e1aff51b tempest-ServerActionsTestOtherB-1049727321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:57:22 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0501ffe-ab51-44ac-9be8-57b928dd91c0]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:57:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-142b0608-5104-49d8-99eb-49ee76d4e79c req-1272301d-6c55-49e5-97f0-73e3e1aff51b tempest-ServerActionsTestOtherB-1049727321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:57:22 devstack sudo[88669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32
Nov 19 12:57:22 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:57:22 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root
Nov 19 12:57:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-142b0608-5104-49d8-99eb-49ee76d4e79c req-1272301d-6c55-49e5-97f0-73e3e1aff51b tempest-ServerActionsTestOtherB-1049727321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32" returned: 0 in 0.736s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:57:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-142b0608-5104-49d8-99eb-49ee76d4e79c req-1272301d-6c55-49e5-97f0-73e3e1aff51b tempest-ServerActionsTestOtherB-1049727321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.808s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:57:22 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-142b0608-5104-49d8-99eb-49ee76d4e79c req-1272301d-6c55-49e5-97f0-73e3e1aff51b tempest-ServerActionsTestOtherB-1049727321 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5eb2f3d-7b69-4bd3-a136-84bb69345c9e', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 12:57:23 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-142b0608-5104-49d8-99eb-49ee76d4e79c req-1272301d-6c55-49e5-97f0-73e3e1aff51b tempest-ServerActionsTestOtherB-1049727321 None] attachment_update completed successfully.
Nov 19 12:57:33 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=13,cinder:UPDATE=13,cinder:INSERT=4 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:57:33 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=15,cinder:UPDATE=11,cinder:DELETE=2 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:57:38 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-e24b0cee-da9f-4c53-a96e-34d89c139d3a req-9d67f11a-4eb9-422b-abc9-4b04d5f6fac3 tempest-ServerActionsTestOtherB-1049727321 None] Terminate volume connection completed successfully.
Nov 19 12:57:38 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-e24b0cee-da9f-4c53-a96e-34d89c139d3a req-9d67f11a-4eb9-422b-abc9-4b04d5f6fac3 tempest-ServerActionsTestOtherB-1049727321 None] Deleting attachment a5eb2f3d-7b69-4bd3-a136-84bb69345c9e. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 12:57:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-bc4d5135-8a4e-4b19-84f8-667494e2ca60 req-f11724cc-211b-453a-81df-9594491dd3e5 tempest-TestInstancesWithCinderVolumes-59473960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:57:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-bc4d5135-8a4e-4b19-84f8-667494e2ca60 req-f11724cc-211b-453a-81df-9594491dd3e5 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:57:44 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1487bad-b2bb-499b-ad55-a5c10bdda627]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:57:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-bc4d5135-8a4e-4b19-84f8-667494e2ca60 req-f11724cc-211b-453a-81df-9594491dd3e5 tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-521f1c2c-dc8d-4a14-9a29-ab622ffb8b55 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:57:44 devstack sudo[88972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-521f1c2c-dc8d-4a14-9a29-ab622ffb8b55
Nov 19 12:57:44 devstack sudo[88972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:57:45 devstack sudo[88972]: pam_unix(sudo:session): session closed for user root
Nov 19 12:57:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-bc4d5135-8a4e-4b19-84f8-667494e2ca60 req-f11724cc-211b-453a-81df-9594491dd3e5 tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-521f1c2c-dc8d-4a14-9a29-ab622ffb8b55" returned: 0 in 0.870s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:57:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-bc4d5135-8a4e-4b19-84f8-667494e2ca60 req-f11724cc-211b-453a-81df-9594491dd3e5 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.888s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:57:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-bc4d5135-8a4e-4b19-84f8-667494e2ca60 req-f11724cc-211b-453a-81df-9594491dd3e5 tempest-TestInstancesWithCinderVolumes-59473960 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-521f1c2c-dc8d-4a14-9a29-ab622ffb8b55', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b18e399b-36b2-4a76-9157-668ddfa34c40', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 12:57:45 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-bc4d5135-8a4e-4b19-84f8-667494e2ca60 req-f11724cc-211b-453a-81df-9594491dd3e5 tempest-TestInstancesWithCinderVolumes-59473960 None] attachment_update completed successfully.
Nov 19 12:57:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-e24b0cee-da9f-4c53-a96e-34d89c139d3a req-8ac6dda8-edb9-46c7-bf7d-ed460c82a1c4 tempest-ServerActionsTestOtherB-1049727321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:57:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-e24b0cee-da9f-4c53-a96e-34d89c139d3a req-8ac6dda8-edb9-46c7-bf7d-ed460c82a1c4 tempest-ServerActionsTestOtherB-1049727321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:57:46 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32ac6d2-d442-46ce-b0bd-190f3a13c7a6]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:57:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-e24b0cee-da9f-4c53-a96e-34d89c139d3a req-8ac6dda8-edb9-46c7-bf7d-ed460c82a1c4 tempest-ServerActionsTestOtherB-1049727321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:57:46 devstack sudo[88988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32
Nov 19 12:57:46 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:57:46 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root
Nov 19 12:57:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-e24b0cee-da9f-4c53-a96e-34d89c139d3a req-8ac6dda8-edb9-46c7-bf7d-ed460c82a1c4 tempest-ServerActionsTestOtherB-1049727321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32" returned: 0 in 0.679s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:57:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-e24b0cee-da9f-4c53-a96e-34d89c139d3a req-8ac6dda8-edb9-46c7-bf7d-ed460c82a1c4 tempest-ServerActionsTestOtherB-1049727321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.691s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:57:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-e24b0cee-da9f-4c53-a96e-34d89c139d3a req-8ac6dda8-edb9-46c7-bf7d-ed460c82a1c4 tempest-ServerActionsTestOtherB-1049727321 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eec7535d-c42e-4396-a2b7-ec03fac6f29a', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 12:57:46 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-e24b0cee-da9f-4c53-a96e-34d89c139d3a req-8ac6dda8-edb9-46c7-bf7d-ed460c82a1c4 tempest-ServerActionsTestOtherB-1049727321 None] attachment_update completed successfully.
Nov 19 12:57:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-7d58527c-f4b3-4633-a3f1-537bcd35f492 req-2024c32f-adab-4b32-8c78-d4fd5e07a853 tempest-TestInstancesWithCinderVolumes-59473960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:57:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-7d58527c-f4b3-4633-a3f1-537bcd35f492 req-2024c32f-adab-4b32-8c78-d4fd5e07a853 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:57:55 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4260b1-f58a-40d4-bc3c-cfdd9669258f]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:57:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-7d58527c-f4b3-4633-a3f1-537bcd35f492 req-2024c32f-adab-4b32-8c78-d4fd5e07a853 tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dd80195e-bb1b-4e27-8021-7fecc6801771 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:57:55 devstack sudo[89172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dd80195e-bb1b-4e27-8021-7fecc6801771
Nov 19 12:57:55 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:57:56 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root
Nov 19 12:57:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-7d58527c-f4b3-4633-a3f1-537bcd35f492 req-2024c32f-adab-4b32-8c78-d4fd5e07a853 tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dd80195e-bb1b-4e27-8021-7fecc6801771" returned: 0 in 0.865s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:57:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-7d58527c-f4b3-4633-a3f1-537bcd35f492 req-2024c32f-adab-4b32-8c78-d4fd5e07a853 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.885s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:57:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-7d58527c-f4b3-4633-a3f1-537bcd35f492 req-2024c32f-adab-4b32-8c78-d4fd5e07a853 tempest-TestInstancesWithCinderVolumes-59473960 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-dd80195e-bb1b-4e27-8021-7fecc6801771', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eeeb4f43-cf6b-4b99-8cb1-31718b9ead1b', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 12:57:56 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-7d58527c-f4b3-4633-a3f1-537bcd35f492 req-2024c32f-adab-4b32-8c78-d4fd5e07a853 tempest-TestInstancesWithCinderVolumes-59473960 None] attachment_update completed successfully.
Nov 19 12:57:57 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-fc25770e-e044-4bc3-bdbd-a125e389e5c1 req-63543650-97f2-49ac-888d-1625cc5de251 tempest-ServerActionsTestOtherB-1049727321 None] Terminate volume connection completed successfully.
Nov 19 12:57:57 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-fc25770e-e044-4bc3-bdbd-a125e389e5c1 req-63543650-97f2-49ac-888d-1625cc5de251 tempest-ServerActionsTestOtherB-1049727321 None] Deleting attachment eec7535d-c42e-4396-a2b7-ec03fac6f29a. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 12:58:00 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b964bd05-f84a-4116-ba4d-fee806dc8ce0 tempest-ServerActionsTestOtherB-1049727321 None] Acquiring lock "cinder-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:58:00 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b964bd05-f84a-4116-ba4d-fee806dc8ce0 tempest-ServerActionsTestOtherB-1049727321 None] Lock "cinder-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:58:00 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b964bd05-f84a-4116-ba4d-fee806dc8ce0 tempest-ServerActionsTestOtherB-1049727321 None] Acquiring lock "cinder-quobyte-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:58:00 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b964bd05-f84a-4116-ba4d-fee806dc8ce0 tempest-ServerActionsTestOtherB-1049727321 None] Lock "cinder-quobyte-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:58:00 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac36f604-cfbc-41db-9ba3-b77cdc8bc055]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:58:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b964bd05-f84a-4116-ba4d-fee806dc8ce0 tempest-ServerActionsTestOtherB-1049727321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:00 devstack sudo[89183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32
Nov 19 12:58:00 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:00 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b964bd05-f84a-4116-ba4d-fee806dc8ce0 tempest-ServerActionsTestOtherB-1049727321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32" returned: 0 in 0.620s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b964bd05-f84a-4116-ba4d-fee806dc8ce0 tempest-ServerActionsTestOtherB-1049727321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:00 devstack sudo[89190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32
Nov 19 12:58:00 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:01 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b964bd05-f84a-4116-ba4d-fee806dc8ce0 tempest-ServerActionsTestOtherB-1049727321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32" returned: 0 in 0.469s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b964bd05-f84a-4116-ba4d-fee806dc8ce0 tempest-ServerActionsTestOtherB-1049727321 None] Lock "cinder-quobyte-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32" released by "delete_volume" :: held 1.153s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:58:01 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-b964bd05-f84a-4116-ba4d-fee806dc8ce0 tempest-ServerActionsTestOtherB-1049727321 None] Created reservations ['01b0e2ef-162f-4591-ac68-8a72fccb35a4', 'dacfa21f-7591-4363-bf0f-6cd4ab7614c8', '2d49023f-4e3c-42ce-b0b5-b64c6d4d5857', '72472935-84c3-4756-92dd-688194a2ef2b'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:58:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b964bd05-f84a-4116-ba4d-fee806dc8ce0 tempest-ServerActionsTestOtherB-1049727321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:58:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b964bd05-f84a-4116-ba4d-fee806dc8ce0 tempest-ServerActionsTestOtherB-1049727321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:58:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b964bd05-f84a-4116-ba4d-fee806dc8ce0 tempest-ServerActionsTestOtherB-1049727321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:58:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b964bd05-f84a-4116-ba4d-fee806dc8ce0 tempest-ServerActionsTestOtherB-1049727321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:58:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b964bd05-f84a-4116-ba4d-fee806dc8ce0 tempest-ServerActionsTestOtherB-1049727321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:58:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b964bd05-f84a-4116-ba4d-fee806dc8ce0 tempest-ServerActionsTestOtherB-1049727321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:01 devstack sudo[89202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:58:01 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:01 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b964bd05-f84a-4116-ba4d-fee806dc8ce0 tempest-ServerActionsTestOtherB-1049727321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.463s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:01 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-b964bd05-f84a-4116-ba4d-fee806dc8ce0 tempest-ServerActionsTestOtherB-1049727321 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:58:01 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-b964bd05-f84a-4116-ba4d-fee806dc8ce0 tempest-ServerActionsTestOtherB-1049727321 None] Deleted volume successfully.
Nov 19 12:58:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b964bd05-f84a-4116-ba4d-fee806dc8ce0 tempest-ServerActionsTestOtherB-1049727321 None] Lock "cinder-d5ffc91b-f5a3-46d2-8a24-d49a06d69b32-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:58:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 12:58:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:58:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:58:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:58:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:58:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:58:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:04 devstack sudo[89221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:58:04 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:05 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.560s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:05 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:58:07 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:58:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Flow 'volume_create_manager' (7cb8ffe0-9f4f-4763-abff-d92302499637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:58:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff130d2-0a82-4417-89bb-6c9e16b1464b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff130d2-0a82-4417-89bb-6c9e16b1464b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1503502535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e0aa1de57da47118bf10d9bb6541fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:58:07Z,use_quota=True,user_id='0df93503c92c4f8fa824501c17c9bbfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388a6445-415f-46ac-bb3e-a6d2f4276a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388a6445-415f-46ac-bb3e-a6d2f4276a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58b35f7b-9749-44e1-8e24-eb074f7e0e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58b35f7b-9749-44e1-8e24-eb074f7e0e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a', 'volume_name': 'volume-25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e423a356-9faa-4d93-a84e-bde9f9adbf9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e423a356-9faa-4d93-a84e-bde9f9adbf9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b1af30-1e42-4cf4-ace8-5fd566bfdd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:07 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Volume 25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a', 'volume_size': 1}
Nov 19 12:58:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:58:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:58:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1503502535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e0aa1de57da47118bf10d9bb6541fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:58:07Z,use_quota=True,user_id='0df93503c92c4f8fa824501c17c9bbfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:58:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Creating volume 25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:58:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:58:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:58:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:58:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:58:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:58:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:58:07 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:58:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:07 devstack sudo[89247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a 1073741824
Nov 19 12:58:07 devstack sudo[89247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:08 devstack sudo[89247]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a 1073741824" returned: 0 in 0.580s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:08 devstack sudo[89256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a
Nov 19 12:58:08 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:08 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a" returned: 0 in 0.537s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:08 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:58:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:58:08 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b1af30-1e42-4cf4-ace8-5fd566bfdd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:08 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97226b55-d0f2-4eb4-8a34-235b61ea0a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:08 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Volume volume-25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a (25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a): created successfully
Nov 19 12:58:08 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97226b55-d0f2-4eb4-8a34-235b61ea0a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:08 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Flow 'volume_create_manager' (7cb8ffe0-9f4f-4763-abff-d92302499637) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:58:08 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-ea444635-48ff-4a4a-8cae-fca115243e6f req-4c140837-dd6c-4008-a752-19307b45dfc8 tempest-VolumesGetTestJSON-1412419773 None] Created volume successfully.
Nov 19 12:58:09 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-e09f4d00-4a85-45aa-946d-6f5bbbb735cf req-67f79260-3b85-4798-910b-11644f695bf7 tempest-VolumesGetTestJSON-1412419773 None] Acquiring lock "cinder-25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:58:09 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-e09f4d00-4a85-45aa-946d-6f5bbbb735cf req-67f79260-3b85-4798-910b-11644f695bf7 tempest-VolumesGetTestJSON-1412419773 None] Lock "cinder-25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:58:09 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-e09f4d00-4a85-45aa-946d-6f5bbbb735cf req-67f79260-3b85-4798-910b-11644f695bf7 tempest-VolumesGetTestJSON-1412419773 None] Acquiring lock "cinder-quobyte-25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:58:09 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-e09f4d00-4a85-45aa-946d-6f5bbbb735cf req-67f79260-3b85-4798-910b-11644f695bf7 tempest-VolumesGetTestJSON-1412419773 None] Lock "cinder-quobyte-25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:58:09 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[26769aa6-0238-4cb9-81e9-1c6c43cc1c10]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:58:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-e09f4d00-4a85-45aa-946d-6f5bbbb735cf req-67f79260-3b85-4798-910b-11644f695bf7 tempest-VolumesGetTestJSON-1412419773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:10 devstack sudo[89267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a
Nov 19 12:58:10 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:10 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-e09f4d00-4a85-45aa-946d-6f5bbbb735cf req-67f79260-3b85-4798-910b-11644f695bf7 tempest-VolumesGetTestJSON-1412419773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a" returned: 0 in 0.724s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-e09f4d00-4a85-45aa-946d-6f5bbbb735cf req-67f79260-3b85-4798-910b-11644f695bf7 tempest-VolumesGetTestJSON-1412419773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:10 devstack sudo[89272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a
Nov 19 12:58:10 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:11 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-e09f4d00-4a85-45aa-946d-6f5bbbb735cf req-67f79260-3b85-4798-910b-11644f695bf7 tempest-VolumesGetTestJSON-1412419773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a" returned: 0 in 0.551s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:11 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-e09f4d00-4a85-45aa-946d-6f5bbbb735cf req-67f79260-3b85-4798-910b-11644f695bf7 tempest-VolumesGetTestJSON-1412419773 None] Lock "cinder-quobyte-25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a" released by "delete_volume" :: held 1.327s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:58:11 devstack cinder-volume[80839]: DEBUG cinder.quota [req-e09f4d00-4a85-45aa-946d-6f5bbbb735cf req-67f79260-3b85-4798-910b-11644f695bf7 tempest-VolumesGetTestJSON-1412419773 None] Created reservations ['8c35b3d4-134e-47e2-b500-bb56eda42eb2', 'b85b547e-4337-487b-bc8d-85c9543a61b6', '2786b1b7-18a0-4df7-a973-4f0f94a95e9a', 'b5940b3a-b854-4530-aeb3-07a90a4efb70'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:58:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-e09f4d00-4a85-45aa-946d-6f5bbbb735cf req-67f79260-3b85-4798-910b-11644f695bf7 tempest-VolumesGetTestJSON-1412419773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:58:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-e09f4d00-4a85-45aa-946d-6f5bbbb735cf req-67f79260-3b85-4798-910b-11644f695bf7 tempest-VolumesGetTestJSON-1412419773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:58:11 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [req-e09f4d00-4a85-45aa-946d-6f5bbbb735cf req-67f79260-3b85-4798-910b-11644f695bf7 tempest-VolumesGetTestJSON-1412419773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:58:11 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [req-e09f4d00-4a85-45aa-946d-6f5bbbb735cf req-67f79260-3b85-4798-910b-11644f695bf7 tempest-VolumesGetTestJSON-1412419773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:58:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-e09f4d00-4a85-45aa-946d-6f5bbbb735cf req-67f79260-3b85-4798-910b-11644f695bf7 tempest-VolumesGetTestJSON-1412419773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:58:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-e09f4d00-4a85-45aa-946d-6f5bbbb735cf req-67f79260-3b85-4798-910b-11644f695bf7 tempest-VolumesGetTestJSON-1412419773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:11 devstack sudo[89275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:58:11 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:11 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-e09f4d00-4a85-45aa-946d-6f5bbbb735cf req-67f79260-3b85-4798-910b-11644f695bf7 tempest-VolumesGetTestJSON-1412419773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.493s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:11 devstack cinder-volume[80839]: DEBUG cinder.manager [req-e09f4d00-4a85-45aa-946d-6f5bbbb735cf req-67f79260-3b85-4798-910b-11644f695bf7 tempest-VolumesGetTestJSON-1412419773 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:58:11 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-e09f4d00-4a85-45aa-946d-6f5bbbb735cf req-67f79260-3b85-4798-910b-11644f695bf7 tempest-VolumesGetTestJSON-1412419773 None] Deleted volume successfully.
Nov 19 12:58:11 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-e09f4d00-4a85-45aa-946d-6f5bbbb735cf req-67f79260-3b85-4798-910b-11644f695bf7 tempest-VolumesGetTestJSON-1412419773 None] Lock "cinder-25457aa5-43a2-4f0a-a6cd-0dc23aca6c4a-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:58:12 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-6a969010-9a65-4d20-9b7b-9e256bc2566b req-af03f315-3828-44e5-a6e7-7cfbc68b15d7 tempest-TestInstancesWithCinderVolumes-59473960 None] Terminate volume connection completed successfully.
Nov 19 12:58:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-6a969010-9a65-4d20-9b7b-9e256bc2566b req-af03f315-3828-44e5-a6e7-7cfbc68b15d7 tempest-TestInstancesWithCinderVolumes-59473960 None] Deleting attachment b18e399b-36b2-4a76-9157-668ddfa34c40. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 12:58:14 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-805aae06-9766-4b80-a85f-4a546edecaa7 tempest-GroupSnapshotsTest-1168928805 None] Group tempest-GroupSnapshotsTest-Group-1372562957: creating
Nov 19 12:58:14 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-805aae06-9766-4b80-a85f-4a546edecaa7 tempest-GroupSnapshotsTest-1168928805 None] Group tempest-GroupSnapshotsTest-Group-1372562957: created successfully
Nov 19 12:58:14 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-805aae06-9766-4b80-a85f-4a546edecaa7 tempest-GroupSnapshotsTest-1168928805 None] Create group completed successfully.
Nov 19 12:58:14 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c0742aa3-dd03-4c11-9549-4e5f616850d1 tempest-TestInstancesWithCinderVolumes-59473960 None] Acquiring lock "cinder-521f1c2c-dc8d-4a14-9a29-ab622ffb8b55-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:58:14 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c0742aa3-dd03-4c11-9549-4e5f616850d1 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "cinder-521f1c2c-dc8d-4a14-9a29-ab622ffb8b55-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:58:14 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c0742aa3-dd03-4c11-9549-4e5f616850d1 tempest-TestInstancesWithCinderVolumes-59473960 None] Acquiring lock "cinder-quobyte-521f1c2c-dc8d-4a14-9a29-ab622ffb8b55" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:58:14 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c0742aa3-dd03-4c11-9549-4e5f616850d1 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "cinder-quobyte-521f1c2c-dc8d-4a14-9a29-ab622ffb8b55" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:58:14 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3565d266-0cfd-4732-b758-6bb8ef934134]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:58:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c0742aa3-dd03-4c11-9549-4e5f616850d1 tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-521f1c2c-dc8d-4a14-9a29-ab622ffb8b55 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:14 devstack sudo[89283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-521f1c2c-dc8d-4a14-9a29-ab622ffb8b55
Nov 19 12:58:14 devstack sudo[89283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:15 devstack sudo[89283]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c0742aa3-dd03-4c11-9549-4e5f616850d1 tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-521f1c2c-dc8d-4a14-9a29-ab622ffb8b55" returned: 0 in 0.646s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c0742aa3-dd03-4c11-9549-4e5f616850d1 tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-521f1c2c-dc8d-4a14-9a29-ab622ffb8b55 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:15 devstack sudo[89291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-521f1c2c-dc8d-4a14-9a29-ab622ffb8b55
Nov 19 12:58:15 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:15 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c0742aa3-dd03-4c11-9549-4e5f616850d1 tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-521f1c2c-dc8d-4a14-9a29-ab622ffb8b55" returned: 0 in 0.667s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:15 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:58:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Flow 'volume_create_manager' (115d6807-0826-427e-9d19-e43418274768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:58:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b84e3315-ad6c-40bd-8f46-a1b2996f4e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c0742aa3-dd03-4c11-9549-4e5f616850d1 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "cinder-quobyte-521f1c2c-dc8d-4a14-9a29-ab622ffb8b55" released by "delete_volume" :: held 1.380s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b84e3315-ad6c-40bd-8f46-a1b2996f4e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-774916433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ce69059d-c9d6-442b-8cb8-af3c0a1c88a4,host='devstack@QuobyteHD#QuobyteHD',id=6a562b45-67c1-4f8c-b163-ae67d970720b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77693ecf98dc4996a10b471bb666c72a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:58:16Z,use_quota=True,user_id='0f7d1c27c9414547aa65aae31b449999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(395c2a4e-d884-4e3e-bfa8-5d7f71e4292d),volume_type_id=395c2a4e-d884-4e3e-bfa8-5d7f71e4292d)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9533a702-c5ed-4507-a611-dd224bdfb25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9533a702-c5ed-4507-a611-dd224bdfb25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ebae46-c57a-4d24-8485-0f5d52e8481a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ebae46-c57a-4d24-8485-0f5d52e8481a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a562b45-67c1-4f8c-b163-ae67d970720b', 'volume_name': 'volume-6a562b45-67c1-4f8c-b163-ae67d970720b', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777a587c-ba74-4795-ae4c-936a2dec284b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777a587c-ba74-4795-ae4c-936a2dec284b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e90e517-42b0-488a-9558-932941c7411d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:16 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Volume 6a562b45-67c1-4f8c-b163-ae67d970720b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a562b45-67c1-4f8c-b163-ae67d970720b', 'volume_size': 1}
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ce69059d-c9d6-442b-8cb8-af3c0a1c88a4,created_at=2025-11-19T11:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-774916433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ce69059d-c9d6-442b-8cb8-af3c0a1c88a4,host='devstack@QuobyteHD#QuobyteHD',id=6a562b45-67c1-4f8c-b163-ae67d970720b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77693ecf98dc4996a10b471bb666c72a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:58:16Z,use_quota=True,user_id='0f7d1c27c9414547aa65aae31b449999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(395c2a4e-d884-4e3e-bfa8-5d7f71e4292d),volume_type_id=395c2a4e-d884-4e3e-bfa8-5d7f71e4292d)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Creating volume 6a562b45-67c1-4f8c-b163-ae67d970720b {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:58:16 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:16 devstack sudo[89294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b 1073741824
Nov 19 12:58:16 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:16 devstack cinder-volume[80839]: WARNING cinder.quota [None req-c0742aa3-dd03-4c11-9549-4e5f616850d1 tempest-TestInstancesWithCinderVolumes-59473960 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1868469057-441029195 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1868469057-441029195, it is now deprecated. Please use the default quota class for default quota.
Nov 19 12:58:16 devstack cinder-volume[80839]: WARNING cinder.quota [None req-c0742aa3-dd03-4c11-9549-4e5f616850d1 tempest-TestInstancesWithCinderVolumes-59473960 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1868469057-441029195 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1868469057-441029195, it is now deprecated. Please use the default quota class for default quota.
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-c0742aa3-dd03-4c11-9549-4e5f616850d1 tempest-TestInstancesWithCinderVolumes-59473960 None] Created reservations ['e261d0d1-73cb-4b14-8a39-f22b19da37f2', 'b405cbe4-8f44-493b-8ace-fa69c3b965c1', 'd70edd94-5af8-4ddf-9feb-e851dc76b050', 'c22dedcb-acbe-4e79-bbce-ac21795eb2fd'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c0742aa3-dd03-4c11-9549-4e5f616850d1 tempest-TestInstancesWithCinderVolumes-59473960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c0742aa3-dd03-4c11-9549-4e5f616850d1 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c0742aa3-dd03-4c11-9549-4e5f616850d1 tempest-TestInstancesWithCinderVolumes-59473960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c0742aa3-dd03-4c11-9549-4e5f616850d1 tempest-TestInstancesWithCinderVolumes-59473960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c0742aa3-dd03-4c11-9549-4e5f616850d1 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c0742aa3-dd03-4c11-9549-4e5f616850d1 tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:16 devstack sudo[89296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:58:16 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:16 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c0742aa3-dd03-4c11-9549-4e5f616850d1 tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.630s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-c0742aa3-dd03-4c11-9549-4e5f616850d1 tempest-TestInstancesWithCinderVolumes-59473960 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:58:16 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-c0742aa3-dd03-4c11-9549-4e5f616850d1 tempest-TestInstancesWithCinderVolumes-59473960 None] Deleted volume successfully.
Nov 19 12:58:16 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c0742aa3-dd03-4c11-9549-4e5f616850d1 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "cinder-521f1c2c-dc8d-4a14-9a29-ab622ffb8b55-delete_volume" released by "delete_volume" :: held 2.277s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:58:17 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b 1073741824" returned: 0 in 1.001s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:17 devstack sudo[89302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b
Nov 19 12:58:17 devstack sudo[89302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:17 devstack sudo[89302]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b" returned: 0 in 0.457s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:58:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:58:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e90e517-42b0-488a-9558-932941c7411d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a562b45-67c1-4f8c-b163-ae67d970720b', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a6d4b5-774c-4b75-95e7-63b1c38b3c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:17 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Volume volume-6a562b45-67c1-4f8c-b163-ae67d970720b (6a562b45-67c1-4f8c-b163-ae67d970720b): created successfully
Nov 19 12:58:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a6d4b5-774c-4b75-95e7-63b1c38b3c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Flow 'volume_create_manager' (115d6807-0826-427e-9d19-e43418274768) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:58:17 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-8155fec2-d366-4832-8a1b-a71a140fab23 tempest-GroupSnapshotsTest-1168928805 None] Created volume successfully.
Nov 19 12:58:18 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-1add0d39-6a36-451b-a348-1a158273306c tempest-GroupSnapshotsTest-1168928805 None] GroupSnapshot 5026007b-f698-4fdb-b7b8-d1fe1ae6edf8: creating.
Nov 19 12:58:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1add0d39-6a36-451b-a348-1a158273306c tempest-GroupSnapshotsTest-1168928805 None] Group snapshot 5026007b-f698-4fdb-b7b8-d1fe1ae6edf8: creating. {{(pid=80839) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4143}}
Nov 19 12:58:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1add0d39-6a36-451b-a348-1a158273306c tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:58:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1add0d39-6a36-451b-a348-1a158273306c tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:58:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-1add0d39-6a36-451b-a348-1a158273306c tempest-GroupSnapshotsTest-1168928805 None] Creating offline snapshot c018030b-b062-4bc3-b061-84e34aea6db9 of volume 6a562b45-67c1-4f8c-b163-ae67d970720b {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 12:58:18 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fef15e7-3193-4224-b460-801af0c39f5f]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:58:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1add0d39-6a36-451b-a348-1a158273306c tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:18 devstack sudo[89311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b
Nov 19 12:58:18 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:18 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1add0d39-6a36-451b-a348-1a158273306c tempest-GroupSnapshotsTest-1168928805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b" returned: 0 in 0.630s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1add0d39-6a36-451b-a348-1a158273306c tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.c018030b-b062-4bc3-b061-84e34aea6db9 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:18 devstack sudo[89319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.c018030b-b062-4bc3-b061-84e34aea6db9 1G
Nov 19 12:58:18 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:19 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1add0d39-6a36-451b-a348-1a158273306c tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.c018030b-b062-4bc3-b061-84e34aea6db9 1G" returned: 0 in 0.595s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1add0d39-6a36-451b-a348-1a158273306c tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a562b45-67c1-4f8c-b163-ae67d970720b -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.c018030b-b062-4bc3-b061-84e34aea6db9 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:19 devstack sudo[89332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a562b45-67c1-4f8c-b163-ae67d970720b -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.c018030b-b062-4bc3-b061-84e34aea6db9
Nov 19 12:58:19 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:20 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1add0d39-6a36-451b-a348-1a158273306c tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a562b45-67c1-4f8c-b163-ae67d970720b -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.c018030b-b062-4bc3-b061-84e34aea6db9" returned: 0 in 0.516s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:20 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-1add0d39-6a36-451b-a348-1a158273306c tempest-GroupSnapshotsTest-1168928805 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.c018030b-b062-4bc3-b061-84e34aea6db9 is being set with open permissions: ugo+rw: NotImplementedError
Nov 19 12:58:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1add0d39-6a36-451b-a348-1a158273306c tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.c018030b-b062-4bc3-b061-84e34aea6db9 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:20 devstack sudo[89341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.c018030b-b062-4bc3-b061-84e34aea6db9
Nov 19 12:58:20 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:20 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1add0d39-6a36-451b-a348-1a158273306c tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.c018030b-b062-4bc3-b061-84e34aea6db9" returned: 0 in 0.457s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1add0d39-6a36-451b-a348-1a158273306c tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:20 devstack sudo[89367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.info
Nov 19 12:58:20 devstack sudo[89367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:20 devstack sudo[89367]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1add0d39-6a36-451b-a348-1a158273306c tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.info" returned: 0 in 0.452s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:20 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-1add0d39-6a36-451b-a348-1a158273306c tempest-GroupSnapshotsTest-1168928805 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 19 12:58:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1add0d39-6a36-451b-a348-1a158273306c tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:20 devstack sudo[89372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.info
Nov 19 12:58:20 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:21 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1add0d39-6a36-451b-a348-1a158273306c tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.info" returned: 0 in 0.452s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1add0d39-6a36-451b-a348-1a158273306c tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.183s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:58:21 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-1add0d39-6a36-451b-a348-1a158273306c tempest-GroupSnapshotsTest-1168928805 None] group_snapshot 5026007b-f698-4fdb-b7b8-d1fe1ae6edf8: created successfully
Nov 19 12:58:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:58:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:58:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "cinder-quobyte-c018030b-b062-4bc3-b061-84e34aea6db9-374366d0-e43a-4265-8e50-b89211124319" by "_create_volume_from_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:58:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-c018030b-b062-4bc3-b061-84e34aea6db9-374366d0-e43a-4265-8e50-b89211124319" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:58:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Creating volume 374366d0-e43a-4265-8e50-b89211124319 from snapshot c018030b-b062-4bc3-b061-84e34aea6db9 {{(pid=80839) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 19 12:58:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:58:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:58:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:58:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:58:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:58:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:58:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "cinder-quobyte-374366d0-e43a-4265-8e50-b89211124319" by "_copy_volume_from_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:58:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-374366d0-e43a-4265-8e50-b89211124319" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:58:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] snapshot: c018030b-b062-4bc3-b061-84e34aea6db9, volume: 374366d0-e43a-4265-8e50-b89211124319,  {{(pid=80839) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:392}}
Nov 19 12:58:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:58:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:58:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:58:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:58:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:58:23 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6910e679-2418-4f2a-8826-26fafc957f99]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:58:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.c018030b-b062-4bc3-b061-84e34aea6db9 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:23 devstack sudo[89378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.c018030b-b062-4bc3-b061-84e34aea6db9
Nov 19 12:58:23 devstack sudo[89378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:24 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-54ecaaaf-9beb-40f4-82ca-d478c2807f5b req-dff52e83-736b-4d94-b857-53ccdcafa2de tempest-TestInstancesWithCinderVolumes-59473960 None] Terminate volume connection completed successfully.
Nov 19 12:58:24 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-54ecaaaf-9beb-40f4-82ca-d478c2807f5b req-dff52e83-736b-4d94-b857-53ccdcafa2de tempest-TestInstancesWithCinderVolumes-59473960 None] Deleting attachment eeeb4f43-cf6b-4b99-8cb1-31718b9ead1b. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 12:58:24 devstack sudo[89378]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.c018030b-b062-4bc3-b061-84e34aea6db9" returned: 0 in 0.625s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:24 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a562b45-67c1-4f8c-b163-ae67d970720b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 12:58:24 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b {{(pid=80839) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:411}}
Nov 19 12:58:24 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Creating direct copy from snapshot {{(pid=80839) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:419}}
Nov 19 12:58:24 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1885c160-8862-492f-9961-7a809dc5cffe]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:58:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:24 devstack sudo[89386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b
Nov 19 12:58:24 devstack sudo[89386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:24 devstack sudo[89386]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b" returned: 0 in 0.610s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:24 devstack cinder-volume[80839]: DEBUG cinder.utils [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Path /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-374366d0-e43a-4265-8e50-b89211124319 not found in is_blk_device check {{(pid=80839) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Nov 19 12:58:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-374366d0-e43a-4265-8e50-b89211124319 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:24 devstack sudo[89394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-374366d0-e43a-4265-8e50-b89211124319
Nov 19 12:58:24 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-10760942-7d83-4115-96d4-60acce1e86d8 tempest-TestInstancesWithCinderVolumes-59473960 None] Acquiring lock "cinder-dd80195e-bb1b-4e27-8021-7fecc6801771-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:58:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-10760942-7d83-4115-96d4-60acce1e86d8 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "cinder-dd80195e-bb1b-4e27-8021-7fecc6801771-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:58:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-10760942-7d83-4115-96d4-60acce1e86d8 tempest-TestInstancesWithCinderVolumes-59473960 None] Acquiring lock "cinder-quobyte-dd80195e-bb1b-4e27-8021-7fecc6801771" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:58:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-10760942-7d83-4115-96d4-60acce1e86d8 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "cinder-quobyte-dd80195e-bb1b-4e27-8021-7fecc6801771" acquired by "delete_volume" :: waited 0.016s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:58:26 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f3f9dc-fb7c-4de8-9eba-9a4ff650456e]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:58:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-10760942-7d83-4115-96d4-60acce1e86d8 tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dd80195e-bb1b-4e27-8021-7fecc6801771 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:26 devstack sudo[89426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dd80195e-bb1b-4e27-8021-7fecc6801771
Nov 19 12:58:26 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:28 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-10760942-7d83-4115-96d4-60acce1e86d8 tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dd80195e-bb1b-4e27-8021-7fecc6801771" returned: 0 in 1.847s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-10760942-7d83-4115-96d4-60acce1e86d8 tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dd80195e-bb1b-4e27-8021-7fecc6801771 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:28 devstack sudo[89436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dd80195e-bb1b-4e27-8021-7fecc6801771
Nov 19 12:58:28 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:29 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-374366d0-e43a-4265-8e50-b89211124319" returned: 0 in 4.828s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:29 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ea0fbf-b201-4826-963e-c574afed86ab]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:58:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:29 devstack sudo[89448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b
Nov 19 12:58:29 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:30 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-10760942-7d83-4115-96d4-60acce1e86d8 tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dd80195e-bb1b-4e27-8021-7fecc6801771" returned: 0 in 1.855s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-10760942-7d83-4115-96d4-60acce1e86d8 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "cinder-quobyte-dd80195e-bb1b-4e27-8021-7fecc6801771" released by "delete_volume" :: held 3.770s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:58:30 devstack cinder-volume[80839]: WARNING cinder.quota [None req-10760942-7d83-4115-96d4-60acce1e86d8 tempest-TestInstancesWithCinderVolumes-59473960 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-895394728-395334068 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-895394728-395334068, it is now deprecated. Please use the default quota class for default quota.
Nov 19 12:58:30 devstack cinder-volume[80839]: WARNING cinder.quota [None req-10760942-7d83-4115-96d4-60acce1e86d8 tempest-TestInstancesWithCinderVolumes-59473960 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-895394728-395334068 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-895394728-395334068, it is now deprecated. Please use the default quota class for default quota.
Nov 19 12:58:30 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-10760942-7d83-4115-96d4-60acce1e86d8 tempest-TestInstancesWithCinderVolumes-59473960 None] Created reservations ['ea4f905d-1c21-4406-90db-7599b30f33d2', '7200dcc5-94de-4971-8a9c-1a3daee0d5c7', '7ee83b5b-789b-482d-927a-0d9e28f2d9d1', '698e9a10-9651-4cb9-8ef5-4bd6d1c1bdcc'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:58:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-10760942-7d83-4115-96d4-60acce1e86d8 tempest-TestInstancesWithCinderVolumes-59473960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:58:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-10760942-7d83-4115-96d4-60acce1e86d8 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:58:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-10760942-7d83-4115-96d4-60acce1e86d8 tempest-TestInstancesWithCinderVolumes-59473960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:58:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-10760942-7d83-4115-96d4-60acce1e86d8 tempest-TestInstancesWithCinderVolumes-59473960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:58:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-10760942-7d83-4115-96d4-60acce1e86d8 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:58:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-10760942-7d83-4115-96d4-60acce1e86d8 tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:30 devstack sudo[89457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:58:30 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:31 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b" returned: 0 in 1.782s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:31 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Image conversion details: src /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b, size 1024.00 MB, duration 4.83 sec, destination /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-374366d0-e43a-4265-8e50-b89211124319 {{(pid=80839) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 19 12:58:31 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Converted 1024.00 MB image at 212.04 MB/s
Nov 19 12:58:31 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-374366d0-e43a-4265-8e50-b89211124319 is being set with open permissions: ugo+rw: NotImplementedError
Nov 19 12:58:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-374366d0-e43a-4265-8e50-b89211124319 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:31 devstack sudo[89509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-374366d0-e43a-4265-8e50-b89211124319
Nov 19 12:58:31 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:31 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-10760942-7d83-4115-96d4-60acce1e86d8 tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 1.448s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:31 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-10760942-7d83-4115-96d4-60acce1e86d8 tempest-TestInstancesWithCinderVolumes-59473960 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:58:31 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-10760942-7d83-4115-96d4-60acce1e86d8 tempest-TestInstancesWithCinderVolumes-59473960 None] Deleted volume successfully.
Nov 19 12:58:31 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-10760942-7d83-4115-96d4-60acce1e86d8 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "cinder-dd80195e-bb1b-4e27-8021-7fecc6801771-delete_volume" released by "delete_volume" :: held 5.543s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:58:32 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-374366d0-e43a-4265-8e50-b89211124319" returned: 0 in 0.960s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:32 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-374366d0-e43a-4265-8e50-b89211124319" released by "_copy_volume_from_snapshot" :: held 8.931s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:58:32 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-c018030b-b062-4bc3-b061-84e34aea6db9-374366d0-e43a-4265-8e50-b89211124319" released by "_create_volume_from_snapshot" :: held 8.965s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:58:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.981s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:58:32 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-0003467d-0126-4f30-a9c4-770c5c5d14d7 tempest-GroupSnapshotsTest-1168928805 None] Create group from source-snapshot-5026007b-f698-4fdb-b7b8-d1fe1ae6edf8 completed successfully.
Nov 19 12:58:33 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=50,cinder:UPDATE=46,cinder:INSERT=4,cinder:DELETE=2 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:58:33 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=58,cinder:UPDATE=44,cinder:INSERT=12,cinder:DELETE=4 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:58:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b7578d28-5b18-40e2-bbd2-b356595c46df tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "cinder-quobyte-374366d0-e43a-4265-8e50-b89211124319" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:58:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b7578d28-5b18-40e2-bbd2-b356595c46df tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-374366d0-e43a-4265-8e50-b89211124319" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:58:33 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cb68ba-8083-4830-ab73-89c58ce3bdd9]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:58:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b7578d28-5b18-40e2-bbd2-b356595c46df tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-374366d0-e43a-4265-8e50-b89211124319 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:33 devstack sudo[89526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-374366d0-e43a-4265-8e50-b89211124319
Nov 19 12:58:33 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:34 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b7578d28-5b18-40e2-bbd2-b356595c46df tempest-GroupSnapshotsTest-1168928805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-374366d0-e43a-4265-8e50-b89211124319" returned: 0 in 0.981s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b7578d28-5b18-40e2-bbd2-b356595c46df tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-374366d0-e43a-4265-8e50-b89211124319 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:34 devstack sudo[89558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-374366d0-e43a-4265-8e50-b89211124319
Nov 19 12:58:34 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:34 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b7578d28-5b18-40e2-bbd2-b356595c46df tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-374366d0-e43a-4265-8e50-b89211124319" returned: 0 in 0.533s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:34 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b7578d28-5b18-40e2-bbd2-b356595c46df tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-374366d0-e43a-4265-8e50-b89211124319" released by "delete_volume" :: held 1.599s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:58:34 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-b7578d28-5b18-40e2-bbd2-b356595c46df tempest-GroupSnapshotsTest-1168928805 None] Created reservations ['f6fc1e45-bd18-4763-b702-d7246a39c0b3'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:58:34 devstack cinder-volume[80839]: WARNING cinder.quota [None req-b7578d28-5b18-40e2-bbd2-b356595c46df tempest-GroupSnapshotsTest-1168928805 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1907641866 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1907641866, it is now deprecated. Please use the default quota class for default quota.
Nov 19 12:58:34 devstack cinder-volume[80839]: WARNING cinder.quota [None req-b7578d28-5b18-40e2-bbd2-b356595c46df tempest-GroupSnapshotsTest-1168928805 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1907641866 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1907641866, it is now deprecated. Please use the default quota class for default quota.
Nov 19 12:58:34 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-b7578d28-5b18-40e2-bbd2-b356595c46df tempest-GroupSnapshotsTest-1168928805 None] Created reservations ['6c28888a-f348-4dbc-bb8e-1111234e6255', 'f4c7b1c9-cf00-4d8e-993f-ff4cb092c7cb', '0bf89f16-9b73-46e6-8b48-34ed11ea985c', '1f545dfb-c7c9-4136-a123-d8681287d50d'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:58:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b7578d28-5b18-40e2-bbd2-b356595c46df tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:58:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b7578d28-5b18-40e2-bbd2-b356595c46df tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:58:34 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b7578d28-5b18-40e2-bbd2-b356595c46df tempest-GroupSnapshotsTest-1168928805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:58:34 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b7578d28-5b18-40e2-bbd2-b356595c46df tempest-GroupSnapshotsTest-1168928805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:58:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b7578d28-5b18-40e2-bbd2-b356595c46df tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:58:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b7578d28-5b18-40e2-bbd2-b356595c46df tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:34 devstack sudo[89561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:58:34 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:35 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-201262d2-ab5f-48f8-bd0c-8aca04c4f3c3 tempest-GroupSnapshotsTest-1168928805 None] group_snapshot 5026007b-f698-4fdb-b7b8-d1fe1ae6edf8: deleting
Nov 19 12:58:35 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-201262d2-ab5f-48f8-bd0c-8aca04c4f3c3 tempest-GroupSnapshotsTest-1168928805 None] group_snapshot 5026007b-f698-4fdb-b7b8-d1fe1ae6edf8: deleting {{(pid=80839) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4318}}
Nov 19 12:58:35 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-201262d2-ab5f-48f8-bd0c-8aca04c4f3c3 tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "cinder-quobyte-6a562b45-67c1-4f8c-b163-ae67d970720b" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:58:35 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-201262d2-ab5f-48f8-bd0c-8aca04c4f3c3 tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-6a562b45-67c1-4f8c-b163-ae67d970720b" acquired by "delete_snapshot" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:58:35 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-201262d2-ab5f-48f8-bd0c-8aca04c4f3c3 tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "cinder-quobyte-c018030b-b062-4bc3-b061-84e34aea6db9" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:58:35 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-201262d2-ab5f-48f8-bd0c-8aca04c4f3c3 tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-c018030b-b062-4bc3-b061-84e34aea6db9" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:58:35 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-201262d2-ab5f-48f8-bd0c-8aca04c4f3c3 tempest-GroupSnapshotsTest-1168928805 None] Deleting offline snapshot c018030b-b062-4bc3-b061-84e34aea6db9 of volume 6a562b45-67c1-4f8c-b163-ae67d970720b {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 12:58:35 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-201262d2-ab5f-48f8-bd0c-8aca04c4f3c3 tempest-GroupSnapshotsTest-1168928805 None] snapshot_file for this snap is: volume-6a562b45-67c1-4f8c-b163-ae67d970720b.c018030b-b062-4bc3-b061-84e34aea6db9 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 12:58:35 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[385e77c3-3c28-4e70-8823-0862a242ef91]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:58:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-201262d2-ab5f-48f8-bd0c-8aca04c4f3c3 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.c018030b-b062-4bc3-b061-84e34aea6db9 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:35 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b7578d28-5b18-40e2-bbd2-b356595c46df tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.643s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:35 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-b7578d28-5b18-40e2-bbd2-b356595c46df tempest-GroupSnapshotsTest-1168928805 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:58:35 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-b7578d28-5b18-40e2-bbd2-b356595c46df tempest-GroupSnapshotsTest-1168928805 None] Delete group completed successfully.
Nov 19 12:58:35 devstack sudo[89571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.c018030b-b062-4bc3-b061-84e34aea6db9
Nov 19 12:58:35 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:36 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-201262d2-ab5f-48f8-bd0c-8aca04c4f3c3 tempest-GroupSnapshotsTest-1168928805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.c018030b-b062-4bc3-b061-84e34aea6db9" returned: 0 in 0.559s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:36 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-201262d2-ab5f-48f8-bd0c-8aca04c4f3c3 tempest-GroupSnapshotsTest-1168928805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a562b45-67c1-4f8c-b163-ae67d970720b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 12:58:36 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e27b58c-e1f1-49fb-8b2a-0b31c9fbbf9d]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:58:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-201262d2-ab5f-48f8-bd0c-8aca04c4f3c3 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:36 devstack sudo[89576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b
Nov 19 12:58:36 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:36 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-2bf19a0e-5cc5-4291-b7f6-dc20b82cadc4 req-dabb67f1-3177-4c84-8a58-5f3f9f72946d tempest-TestInstancesWithCinderVolumes-59473960 None] Terminate volume connection completed successfully.
Nov 19 12:58:36 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-2bf19a0e-5cc5-4291-b7f6-dc20b82cadc4 req-dabb67f1-3177-4c84-8a58-5f3f9f72946d tempest-TestInstancesWithCinderVolumes-59473960 None] Deleting attachment 91f5ebfb-620d-4109-a2dd-ebc4060c0e4d. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 12:58:36 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-201262d2-ab5f-48f8-bd0c-8aca04c4f3c3 tempest-GroupSnapshotsTest-1168928805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b" returned: 0 in 0.608s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-201262d2-ab5f-48f8-bd0c-8aca04c4f3c3 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.c018030b-b062-4bc3-b061-84e34aea6db9 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:36 devstack sudo[89581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.c018030b-b062-4bc3-b061-84e34aea6db9
Nov 19 12:58:36 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:37 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-201262d2-ab5f-48f8-bd0c-8aca04c4f3c3 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.c018030b-b062-4bc3-b061-84e34aea6db9" returned: 0 in 0.499s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-201262d2-ab5f-48f8-bd0c-8aca04c4f3c3 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.c018030b-b062-4bc3-b061-84e34aea6db9 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:37 devstack sudo[89586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.c018030b-b062-4bc3-b061-84e34aea6db9
Nov 19 12:58:37 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:37 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-201262d2-ab5f-48f8-bd0c-8aca04c4f3c3 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b.c018030b-b062-4bc3-b061-84e34aea6db9" returned: 0 in 0.504s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:37 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-201262d2-ab5f-48f8-bd0c-8aca04c4f3c3 tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-c018030b-b062-4bc3-b061-84e34aea6db9" released by "_delete_snapshot" :: held 2.246s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:58:37 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-201262d2-ab5f-48f8-bd0c-8aca04c4f3c3 tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-6a562b45-67c1-4f8c-b163-ae67d970720b" released by "delete_snapshot" :: held 2.257s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:58:37 devstack cinder-volume[80839]: WARNING cinder.quota [None req-201262d2-ab5f-48f8-bd0c-8aca04c4f3c3 tempest-GroupSnapshotsTest-1168928805 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1907641866 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1907641866, it is now deprecated. Please use the default quota class for default quota.
Nov 19 12:58:37 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-201262d2-ab5f-48f8-bd0c-8aca04c4f3c3 tempest-GroupSnapshotsTest-1168928805 None] Created reservations ['6c42f0ed-5490-4ee8-9810-f1320f0d7280', 'd5e1c52d-0aba-422f-809a-8f5decd5cf7d', 'c9ff351d-5f5e-4158-ac03-558eccc005f1', '6da5c014-38f3-472c-babf-17f2c6a845b6'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:58:37 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-201262d2-ab5f-48f8-bd0c-8aca04c4f3c3 tempest-GroupSnapshotsTest-1168928805 None] group_snapshot 5026007b-f698-4fdb-b7b8-d1fe1ae6edf8: deleted successfully
Nov 19 12:58:38 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9eacd05c-2d41-4e9b-a164-ce3f76906bbc tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "cinder-quobyte-6a562b45-67c1-4f8c-b163-ae67d970720b" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:58:38 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9eacd05c-2d41-4e9b-a164-ce3f76906bbc tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-6a562b45-67c1-4f8c-b163-ae67d970720b" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:58:38 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acc158a-1b64-44f5-9474-49a9d5924a00]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:58:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9eacd05c-2d41-4e9b-a164-ce3f76906bbc tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:38 devstack sudo[89590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b
Nov 19 12:58:38 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:39 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9eacd05c-2d41-4e9b-a164-ce3f76906bbc tempest-GroupSnapshotsTest-1168928805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b" returned: 0 in 0.577s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9eacd05c-2d41-4e9b-a164-ce3f76906bbc tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:39 devstack sudo[89595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b
Nov 19 12:58:39 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:39 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-393d8eec-85b0-4cd1-9d19-8e241814f2e2 tempest-TestInstancesWithCinderVolumes-59473960 None] Acquiring lock "cinder-b7ae9f79-302d-4d78-94a1-2d75153ef170-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:58:39 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-393d8eec-85b0-4cd1-9d19-8e241814f2e2 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "cinder-b7ae9f79-302d-4d78-94a1-2d75153ef170-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:58:39 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-393d8eec-85b0-4cd1-9d19-8e241814f2e2 tempest-TestInstancesWithCinderVolumes-59473960 None] Acquiring lock "cinder-quobyte-b7ae9f79-302d-4d78-94a1-2d75153ef170" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:58:39 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-393d8eec-85b0-4cd1-9d19-8e241814f2e2 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "cinder-quobyte-b7ae9f79-302d-4d78-94a1-2d75153ef170" acquired by "delete_volume" :: waited 0.012s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:58:39 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf01c90-a083-4868-a190-424f1faa5d1f]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:58:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-393d8eec-85b0-4cd1-9d19-8e241814f2e2 tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:39 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9eacd05c-2d41-4e9b-a164-ce3f76906bbc tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6a562b45-67c1-4f8c-b163-ae67d970720b" returned: 0 in 0.516s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:39 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9eacd05c-2d41-4e9b-a164-ce3f76906bbc tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-6a562b45-67c1-4f8c-b163-ae67d970720b" released by "delete_volume" :: held 1.128s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:58:39 devstack sudo[89597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170
Nov 19 12:58:39 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:39 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-9eacd05c-2d41-4e9b-a164-ce3f76906bbc tempest-GroupSnapshotsTest-1168928805 None] Created reservations ['ac595b8a-d14f-4a16-9513-8cca7f946bf6'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:58:39 devstack cinder-volume[80839]: WARNING cinder.db.sqlalchemy.api [None req-9eacd05c-2d41-4e9b-a164-ce3f76906bbc tempest-GroupSnapshotsTest-1168928805 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1907641866']
Nov 19 12:58:40 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-9eacd05c-2d41-4e9b-a164-ce3f76906bbc tempest-GroupSnapshotsTest-1168928805 None] Created reservations ['25aecb5d-d6c1-4157-b4c6-0cf7fc50e2ce', '8e8260a9-b17e-4999-be3a-7f7536e6d4c3', 'f69efc0e-ca68-4b0b-aff5-a613fb8d953d', '1ef29366-b908-4e36-aadb-17df4cb3386d'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:58:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9eacd05c-2d41-4e9b-a164-ce3f76906bbc tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:58:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9eacd05c-2d41-4e9b-a164-ce3f76906bbc tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:58:40 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-9eacd05c-2d41-4e9b-a164-ce3f76906bbc tempest-GroupSnapshotsTest-1168928805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:58:40 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-9eacd05c-2d41-4e9b-a164-ce3f76906bbc tempest-GroupSnapshotsTest-1168928805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:58:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9eacd05c-2d41-4e9b-a164-ce3f76906bbc tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:58:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9eacd05c-2d41-4e9b-a164-ce3f76906bbc tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:40 devstack sudo[89600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:58:40 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:40 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-393d8eec-85b0-4cd1-9d19-8e241814f2e2 tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170" returned: 0 in 0.647s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-393d8eec-85b0-4cd1-9d19-8e241814f2e2 tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:40 devstack sudo[89604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170
Nov 19 12:58:40 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:40 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9eacd05c-2d41-4e9b-a164-ce3f76906bbc tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.495s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:40 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-9eacd05c-2d41-4e9b-a164-ce3f76906bbc tempest-GroupSnapshotsTest-1168928805 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:58:40 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-9eacd05c-2d41-4e9b-a164-ce3f76906bbc tempest-GroupSnapshotsTest-1168928805 None] Delete group completed successfully.
Nov 19 12:58:40 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-393d8eec-85b0-4cd1-9d19-8e241814f2e2 tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170" returned: 1 in 0.559s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-393d8eec-85b0-4cd1-9d19-8e241814f2e2 tempest-TestInstancesWithCinderVolumes-59473960 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 12:58:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-393d8eec-85b0-4cd1-9d19-8e241814f2e2 tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:40 devstack sudo[89610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170
Nov 19 12:58:40 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:41 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-3211a48e-6ecd-49e3-b4f7-09ec9a8a3231 tempest-GroupSnapshotsTest-1168928805 None] Group tempest-GroupSnapshotsTest-Group-632503184: creating
Nov 19 12:58:41 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-3211a48e-6ecd-49e3-b4f7-09ec9a8a3231 tempest-GroupSnapshotsTest-1168928805 None] Group tempest-GroupSnapshotsTest-Group-632503184: created successfully
Nov 19 12:58:41 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-3211a48e-6ecd-49e3-b4f7-09ec9a8a3231 tempest-GroupSnapshotsTest-1168928805 None] Create group completed successfully.
Nov 19 12:58:41 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-393d8eec-85b0-4cd1-9d19-8e241814f2e2 tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b7ae9f79-302d-4d78-94a1-2d75153ef170" returned: 0 in 0.552s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:41 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-393d8eec-85b0-4cd1-9d19-8e241814f2e2 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "cinder-quobyte-b7ae9f79-302d-4d78-94a1-2d75153ef170" released by "delete_volume" :: held 1.827s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:58:41 devstack cinder-volume[80839]: WARNING cinder.quota [None req-393d8eec-85b0-4cd1-9d19-8e241814f2e2 tempest-TestInstancesWithCinderVolumes-59473960 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1027474199-1893003722 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1027474199-1893003722, it is now deprecated. Please use the default quota class for default quota.
Nov 19 12:58:41 devstack cinder-volume[80839]: WARNING cinder.quota [None req-393d8eec-85b0-4cd1-9d19-8e241814f2e2 tempest-TestInstancesWithCinderVolumes-59473960 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1027474199-1893003722 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1027474199-1893003722, it is now deprecated. Please use the default quota class for default quota.
Nov 19 12:58:41 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-393d8eec-85b0-4cd1-9d19-8e241814f2e2 tempest-TestInstancesWithCinderVolumes-59473960 None] Created reservations ['7bd78e26-07c6-4cf8-aefd-4da2fa1a76ef', 'd75c5c26-6a60-455e-b205-d2dcb9a29b66', '8364e8e8-bcad-4b5e-b02f-0784023b2d67', '07c9022d-5158-415b-a467-14a62f8fa145'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:58:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-393d8eec-85b0-4cd1-9d19-8e241814f2e2 tempest-TestInstancesWithCinderVolumes-59473960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:58:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-393d8eec-85b0-4cd1-9d19-8e241814f2e2 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:58:41 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-393d8eec-85b0-4cd1-9d19-8e241814f2e2 tempest-TestInstancesWithCinderVolumes-59473960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:58:41 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-393d8eec-85b0-4cd1-9d19-8e241814f2e2 tempest-TestInstancesWithCinderVolumes-59473960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:58:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-393d8eec-85b0-4cd1-9d19-8e241814f2e2 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:58:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-393d8eec-85b0-4cd1-9d19-8e241814f2e2 tempest-TestInstancesWithCinderVolumes-59473960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:41 devstack sudo[89616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:58:41 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:42 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-393d8eec-85b0-4cd1-9d19-8e241814f2e2 tempest-TestInstancesWithCinderVolumes-59473960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.505s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:42 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-393d8eec-85b0-4cd1-9d19-8e241814f2e2 tempest-TestInstancesWithCinderVolumes-59473960 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:58:42 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-393d8eec-85b0-4cd1-9d19-8e241814f2e2 tempest-TestInstancesWithCinderVolumes-59473960 None] Deleted volume successfully.
Nov 19 12:58:42 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-393d8eec-85b0-4cd1-9d19-8e241814f2e2 tempest-TestInstancesWithCinderVolumes-59473960 None] Lock "cinder-b7ae9f79-302d-4d78-94a1-2d75153ef170-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:58:42 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:58:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Flow 'volume_create_manager' (56628186-b3ba-494f-8c92-5ce378815d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:58:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f4ec37b-bc74-4695-b2eb-2e81c61edd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f4ec37b-bc74-4695-b2eb-2e81c61edd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1887796704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=42ef68cc-f6ca-4884-9873-36fd9e475f22,host='devstack@QuobyteHD#QuobyteHD',id=a3c18534-ce6b-45e2-b448-17e4287da594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77693ecf98dc4996a10b471bb666c72a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:58:43Z,use_quota=True,user_id='0f7d1c27c9414547aa65aae31b449999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8b5bc48-0e78-4ef8-b41c-ec27390edae6),volume_type_id=b8b5bc48-0e78-4ef8-b41c-ec27390edae6)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fb972f-711a-4770-81b8-31eaff414355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fb972f-711a-4770-81b8-31eaff414355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31fa437c-e510-4b8a-9a5c-f9b12d8ae45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31fa437c-e510-4b8a-9a5c-f9b12d8ae45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3c18534-ce6b-45e2-b448-17e4287da594', 'volume_name': 'volume-a3c18534-ce6b-45e2-b448-17e4287da594', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c53bce1-18a4-4a6d-b92d-37340117497a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c53bce1-18a4-4a6d-b92d-37340117497a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67bf4e94-0bc5-4baa-a605-cf519109ee33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:42 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Volume a3c18534-ce6b-45e2-b448-17e4287da594: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3c18534-ce6b-45e2-b448-17e4287da594', 'volume_size': 1}
Nov 19 12:58:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:58:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:58:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=42ef68cc-f6ca-4884-9873-36fd9e475f22,created_at=2025-11-19T11:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1887796704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=42ef68cc-f6ca-4884-9873-36fd9e475f22,host='devstack@QuobyteHD#QuobyteHD',id=a3c18534-ce6b-45e2-b448-17e4287da594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77693ecf98dc4996a10b471bb666c72a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:58:43Z,use_quota=True,user_id='0f7d1c27c9414547aa65aae31b449999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8b5bc48-0e78-4ef8-b41c-ec27390edae6),volume_type_id=b8b5bc48-0e78-4ef8-b41c-ec27390edae6)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:58:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Creating volume a3c18534-ce6b-45e2-b448-17e4287da594 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:58:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:58:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:58:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:58:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:58:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:58:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:58:42 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:58:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:42 devstack sudo[89628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594 1073741824
Nov 19 12:58:42 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:43 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594 1073741824" returned: 0 in 0.786s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:43 devstack sudo[89637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594
Nov 19 12:58:43 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:44 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594" returned: 0 in 0.536s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:44 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:58:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:58:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67bf4e94-0bc5-4baa-a605-cf519109ee33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3c18534-ce6b-45e2-b448-17e4287da594', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb02e9e7-d9fc-4015-a4fa-af82a50df9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:44 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Volume volume-a3c18534-ce6b-45e2-b448-17e4287da594 (a3c18534-ce6b-45e2-b448-17e4287da594): created successfully
Nov 19 12:58:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb02e9e7-d9fc-4015-a4fa-af82a50df9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Flow 'volume_create_manager' (56628186-b3ba-494f-8c92-5ce378815d40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:58:44 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-f7d73b76-dc94-4d9c-960f-8e8f4bd9d4ca tempest-GroupSnapshotsTest-1168928805 None] Created volume successfully.
Nov 19 12:58:45 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:58:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Flow 'volume_create_manager' (05f677e3-b34a-4947-b8c3-b6e00f7c96d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:58:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf328466-30d2-41b3-b261-2f985132739e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf328466-30d2-41b3-b261-2f985132739e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-443213267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=42ef68cc-f6ca-4884-9873-36fd9e475f22,host='devstack@QuobyteHD#QuobyteHD',id=639afea6-5485-4013-8486-f36a3d592201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77693ecf98dc4996a10b471bb666c72a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:58:45Z,use_quota=True,user_id='0f7d1c27c9414547aa65aae31b449999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8b5bc48-0e78-4ef8-b41c-ec27390edae6),volume_type_id=b8b5bc48-0e78-4ef8-b41c-ec27390edae6)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb92b3f-9cd2-4024-a0a5-e9c32855f638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb92b3f-9cd2-4024-a0a5-e9c32855f638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f6d8cd-84fb-44e8-8f7e-c0f44a515024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f6d8cd-84fb-44e8-8f7e-c0f44a515024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '639afea6-5485-4013-8486-f36a3d592201', 'volume_name': 'volume-639afea6-5485-4013-8486-f36a3d592201', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b9dbc9-d81a-4873-82a4-d498337d8529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b9dbc9-d81a-4873-82a4-d498337d8529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d32dc5e7-3820-4e3b-a997-2b0c8d352234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:45 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Volume 639afea6-5485-4013-8486-f36a3d592201: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-639afea6-5485-4013-8486-f36a3d592201', 'volume_size': 1}
Nov 19 12:58:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:58:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:58:45 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=42ef68cc-f6ca-4884-9873-36fd9e475f22,created_at=2025-11-19T11:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-443213267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=42ef68cc-f6ca-4884-9873-36fd9e475f22,host='devstack@QuobyteHD#QuobyteHD',id=639afea6-5485-4013-8486-f36a3d592201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77693ecf98dc4996a10b471bb666c72a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:58:45Z,use_quota=True,user_id='0f7d1c27c9414547aa65aae31b449999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8b5bc48-0e78-4ef8-b41c-ec27390edae6),volume_type_id=b8b5bc48-0e78-4ef8-b41c-ec27390edae6)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:58:45 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Creating volume 639afea6-5485-4013-8486-f36a3d592201 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:58:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:58:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:58:45 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:58:45 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:58:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:58:45 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:58:45 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:58:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:45 devstack sudo[89653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201 1073741824
Nov 19 12:58:45 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-a3da6b38-f371-4c9d-96dd-59983c9ec5ff req-038757c7-aa38-40db-ba00-281005503b64 tempest-ServerRescueNegativeTestJSON-79025645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:58:46 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201 1073741824" returned: 0 in 0.620s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:46 devstack sudo[89658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201
Nov 19 12:58:46 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:46 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201" returned: 0 in 0.536s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:46 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:58:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:58:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-a3da6b38-f371-4c9d-96dd-59983c9ec5ff req-038757c7-aa38-40db-ba00-281005503b64 tempest-ServerRescueNegativeTestJSON-79025645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.130s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:58:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d32dc5e7-3820-4e3b-a997-2b0c8d352234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-639afea6-5485-4013-8486-f36a3d592201', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44693825-98f9-4e06-8c11-872d2e900e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:46 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee704cc-12a9-4155-a782-df1d2ca2d92f]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:58:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-a3da6b38-f371-4c9d-96dd-59983c9ec5ff req-038757c7-aa38-40db-ba00-281005503b64 tempest-ServerRescueNegativeTestJSON-79025645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d4513d94-d757-4df6-8886-a8c37ae19bc3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:46 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Volume volume-639afea6-5485-4013-8486-f36a3d592201 (639afea6-5485-4013-8486-f36a3d592201): created successfully
Nov 19 12:58:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44693825-98f9-4e06-8c11-872d2e900e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Flow 'volume_create_manager' (05f677e3-b34a-4947-b8c3-b6e00f7c96d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:58:46 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-d7565519-ae3d-4e63-ab27-13905eb5ed19 tempest-GroupSnapshotsTest-1168928805 None] Created volume successfully.
Nov 19 12:58:46 devstack sudo[89662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d4513d94-d757-4df6-8886-a8c37ae19bc3
Nov 19 12:58:46 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:47 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-a3da6b38-f371-4c9d-96dd-59983c9ec5ff req-038757c7-aa38-40db-ba00-281005503b64 tempest-ServerRescueNegativeTestJSON-79025645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d4513d94-d757-4df6-8886-a8c37ae19bc3" returned: 0 in 0.613s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-a3da6b38-f371-4c9d-96dd-59983c9ec5ff req-038757c7-aa38-40db-ba00-281005503b64 tempest-ServerRescueNegativeTestJSON-79025645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.634s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:58:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-a3da6b38-f371-4c9d-96dd-59983c9ec5ff req-038757c7-aa38-40db-ba00-281005503b64 tempest-ServerRescueNegativeTestJSON-79025645 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-d4513d94-d757-4df6-8886-a8c37ae19bc3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4347c080-cc97-4423-a5d7-5499a5f249c0', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 12:58:47 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-a3da6b38-f371-4c9d-96dd-59983c9ec5ff req-038757c7-aa38-40db-ba00-281005503b64 tempest-ServerRescueNegativeTestJSON-79025645 None] attachment_update completed successfully.
Nov 19 12:58:47 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-491165e7-3afa-4f14-b5a7-676788be4596 tempest-GroupSnapshotsTest-1168928805 None] Update group completed successfully.
Nov 19 12:58:48 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-58450ab5-7aa0-4550-8f93-dcd467edff83 tempest-GroupSnapshotsTest-1168928805 None] Update group completed successfully.
Nov 19 12:58:49 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-a3f643d6-1da7-47a6-b866-efd268a07521 tempest-GroupSnapshotsTest-1168928805 None] Update group completed successfully.
Nov 19 12:58:51 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-34e9e98d-e3a2-45df-9ca5-7769d7348206 tempest-GroupSnapshotsTest-1168928805 None] Update group completed successfully.
Nov 19 12:58:52 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] GroupSnapshot b00f35c3-1419-4c80-a887-26da018cd41e: creating.
Nov 19 12:58:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] Group snapshot b00f35c3-1419-4c80-a887-26da018cd41e: creating. {{(pid=80839) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4143}}
Nov 19 12:58:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:58:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:58:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] Creating offline snapshot 5b41969c-b591-41cc-a731-67d4e0b09a90 of volume a3c18534-ce6b-45e2-b448-17e4287da594 {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 12:58:52 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[082ebf54-b385-4167-9ce7-48cfc9ee1139]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:58:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:52 devstack sudo[90054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594
Nov 19 12:58:52 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:53 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594" returned: 0 in 0.770s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594.5b41969c-b591-41cc-a731-67d4e0b09a90 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:53 devstack sudo[90062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594.5b41969c-b591-41cc-a731-67d4e0b09a90 1G
Nov 19 12:58:53 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:53 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594.5b41969c-b591-41cc-a731-67d4e0b09a90 1G" returned: 0 in 0.635s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3c18534-ce6b-45e2-b448-17e4287da594 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594.5b41969c-b591-41cc-a731-67d4e0b09a90 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:53 devstack sudo[90083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3c18534-ce6b-45e2-b448-17e4287da594 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594.5b41969c-b591-41cc-a731-67d4e0b09a90
Nov 19 12:58:53 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:54 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3c18534-ce6b-45e2-b448-17e4287da594 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594.5b41969c-b591-41cc-a731-67d4e0b09a90" returned: 0 in 0.579s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:54 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594.5b41969c-b591-41cc-a731-67d4e0b09a90 is being set with open permissions: ugo+rw: NotImplementedError
Nov 19 12:58:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594.5b41969c-b591-41cc-a731-67d4e0b09a90 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:54 devstack sudo[90088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594.5b41969c-b591-41cc-a731-67d4e0b09a90
Nov 19 12:58:54 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:55 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594.5b41969c-b591-41cc-a731-67d4e0b09a90" returned: 0 in 0.752s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:55 devstack sudo[90125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594.info
Nov 19 12:58:55 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:56 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:58:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Flow 'volume_create_manager' (66827b68-79d3-46a7-8127-1471be935c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:58:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5b5e39-74b6-474b-b3c1-ca45ded26eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:56 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594.info" returned: 0 in 0.835s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:56 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 19 12:58:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5b5e39-74b6-474b-b3c1-ca45ded26eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1382489733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e2321bf-4965-464a-86bc-2ef7696e40e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b35bd912eb5347d7b0afaad572df9393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:58:56Z,use_quota=True,user_id='ebf046c3607e467fbb39418bc52f77f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef74eec8-4204-4158-9e6e-65babb3ae2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef74eec8-4204-4158-9e6e-65babb3ae2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df1e567c-f3c6-4898-91a4-64f9e4755499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df1e567c-f3c6-4898-91a4-64f9e4755499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e2321bf-4965-464a-86bc-2ef7696e40e7', 'volume_name': 'volume-7e2321bf-4965-464a-86bc-2ef7696e40e7', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:56 devstack sudo[90132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594.info
Nov 19 12:58:56 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a179d200-0d79-4324-b6e0-3d7287dc2e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a179d200-0d79-4324-b6e0-3d7287dc2e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:58:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c5985c6-c809-4f68-8dc1-81c8cdd3ad25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:58:56 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Volume 7e2321bf-4965-464a-86bc-2ef7696e40e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e2321bf-4965-464a-86bc-2ef7696e40e7', 'volume_size': 1}
Nov 19 12:58:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:58:56 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594.info" returned: 0 in 0.598s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.219s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:58:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:58:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:58:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] Creating offline snapshot 5eeb17a6-ce73-43c0-aa2c-bb61b91d3254 of volume 639afea6-5485-4013-8486-f36a3d592201 {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 12:58:56 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7afe6d-ba14-4fb1-9f44-822bb5a76d74]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:58:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:56 devstack sudo[90141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201
Nov 19 12:58:56 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:57 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201" returned: 0 in 0.563s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201.5eeb17a6-ce73-43c0-aa2c-bb61b91d3254 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:57 devstack sudo[90146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201.5eeb17a6-ce73-43c0-aa2c-bb61b91d3254 1G
Nov 19 12:58:57 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:57 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201.5eeb17a6-ce73-43c0-aa2c-bb61b91d3254 1G" returned: 0 in 0.546s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-639afea6-5485-4013-8486-f36a3d592201 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201.5eeb17a6-ce73-43c0-aa2c-bb61b91d3254 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:57 devstack sudo[90151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-639afea6-5485-4013-8486-f36a3d592201 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201.5eeb17a6-ce73-43c0-aa2c-bb61b91d3254
Nov 19 12:58:57 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:58 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-639afea6-5485-4013-8486-f36a3d592201 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201.5eeb17a6-ce73-43c0-aa2c-bb61b91d3254" returned: 0 in 0.512s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:58 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201.5eeb17a6-ce73-43c0-aa2c-bb61b91d3254 is being set with open permissions: ugo+rw: NotImplementedError
Nov 19 12:58:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201.5eeb17a6-ce73-43c0-aa2c-bb61b91d3254 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:58 devstack sudo[90156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201.5eeb17a6-ce73-43c0-aa2c-bb61b91d3254
Nov 19 12:58:58 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:58 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201.5eeb17a6-ce73-43c0-aa2c-bb61b91d3254" returned: 0 in 0.469s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:58 devstack sudo[90159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201.info
Nov 19 12:58:58 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:59 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201.info" returned: 0 in 0.563s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:59 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 19 12:58:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:59 devstack sudo[90162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201.info
Nov 19 12:58:59 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:59 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root
Nov 19 12:58:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201.info" returned: 0 in 0.480s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:58:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.183s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:58:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.756s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:58:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1382489733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e2321bf-4965-464a-86bc-2ef7696e40e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b35bd912eb5347d7b0afaad572df9393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:58:56Z,use_quota=True,user_id='ebf046c3607e467fbb39418bc52f77f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:58:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Creating volume 7e2321bf-4965-464a-86bc-2ef7696e40e7 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:58:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:58:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:58:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:58:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:58:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:58:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:58:59 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:58:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7e2321bf-4965-464a-86bc-2ef7696e40e7 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:58:59 devstack sudo[90165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7e2321bf-4965-464a-86bc-2ef7696e40e7 1073741824
Nov 19 12:58:59 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:58:59 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-f5967621-72b6-41d6-8b7b-01bb88b8d102 tempest-GroupSnapshotsTest-1168928805 None] group_snapshot b00f35c3-1419-4c80-a887-26da018cd41e: created successfully
Nov 19 12:59:00 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7e2321bf-4965-464a-86bc-2ef7696e40e7 1073741824" returned: 0 in 0.986s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7e2321bf-4965-464a-86bc-2ef7696e40e7 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:00 devstack sudo[90205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7e2321bf-4965-464a-86bc-2ef7696e40e7
Nov 19 12:59:00 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:00 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] group_snapshot b00f35c3-1419-4c80-a887-26da018cd41e: deleting
Nov 19 12:59:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] group_snapshot b00f35c3-1419-4c80-a887-26da018cd41e: deleting {{(pid=80839) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4318}}
Nov 19 12:59:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "cinder-quobyte-a3c18534-ce6b-45e2-b448-17e4287da594" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:59:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-a3c18534-ce6b-45e2-b448-17e4287da594" acquired by "delete_snapshot" :: waited 0.021s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:59:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "cinder-quobyte-5b41969c-b591-41cc-a731-67d4e0b09a90" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:59:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-5b41969c-b591-41cc-a731-67d4e0b09a90" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:59:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Deleting offline snapshot 5b41969c-b591-41cc-a731-67d4e0b09a90 of volume a3c18534-ce6b-45e2-b448-17e4287da594 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 12:59:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] snapshot_file for this snap is: volume-a3c18534-ce6b-45e2-b448-17e4287da594.5b41969c-b591-41cc-a731-67d4e0b09a90 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 12:59:01 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2bc6e8-f153-4671-9677-b8a102719c63]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:59:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594.5b41969c-b591-41cc-a731-67d4e0b09a90 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:01 devstack sudo[90207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594.5b41969c-b591-41cc-a731-67d4e0b09a90
Nov 19 12:59:01 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:01 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7e2321bf-4965-464a-86bc-2ef7696e40e7" returned: 0 in 0.615s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:59:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:59:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c5985c6-c809-4f68-8dc1-81c8cdd3ad25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e2321bf-4965-464a-86bc-2ef7696e40e7', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:59:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c56d9bd-379e-4e73-81ad-c39a5244ea0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:59:01 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Volume volume-7e2321bf-4965-464a-86bc-2ef7696e40e7 (7e2321bf-4965-464a-86bc-2ef7696e40e7): created successfully
Nov 19 12:59:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c56d9bd-379e-4e73-81ad-c39a5244ea0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:59:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Flow 'volume_create_manager' (66827b68-79d3-46a7-8127-1471be935c44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:59:01 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-7e8bffae-e0d7-475a-ba71-09d94b3f24c9 tempest-AttachVolumeShelveTestJSON-1725620549 None] Created volume successfully.
Nov 19 12:59:01 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594.5b41969c-b591-41cc-a731-67d4e0b09a90" returned: 0 in 0.804s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3c18534-ce6b-45e2-b448-17e4287da594(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 12:59:01 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c1e576-31d8-405f-8b9d-4ca6e2575440]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:59:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:02 devstack sudo[90213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594
Nov 19 12:59:02 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:02 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594" returned: 0 in 0.742s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594.5b41969c-b591-41cc-a731-67d4e0b09a90 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:02 devstack sudo[90221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594.5b41969c-b591-41cc-a731-67d4e0b09a90
Nov 19 12:59:02 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:03 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594.5b41969c-b591-41cc-a731-67d4e0b09a90" returned: 0 in 0.864s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594.5b41969c-b591-41cc-a731-67d4e0b09a90 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:03 devstack sudo[90228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594.5b41969c-b591-41cc-a731-67d4e0b09a90
Nov 19 12:59:03 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:04 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594.5b41969c-b591-41cc-a731-67d4e0b09a90" returned: 0 in 0.831s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:04 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-5b41969c-b591-41cc-a731-67d4e0b09a90" released by "_delete_snapshot" :: held 3.376s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:59:04 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-a3c18534-ce6b-45e2-b448-17e4287da594" released by "delete_snapshot" :: held 3.401s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:59:04 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "cinder-quobyte-639afea6-5485-4013-8486-f36a3d592201" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:59:04 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-639afea6-5485-4013-8486-f36a3d592201" acquired by "delete_snapshot" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:59:04 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "cinder-quobyte-5eeb17a6-ce73-43c0-aa2c-bb61b91d3254" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:59:04 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-5eeb17a6-ce73-43c0-aa2c-bb61b91d3254" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:59:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Deleting offline snapshot 5eeb17a6-ce73-43c0-aa2c-bb61b91d3254 of volume 639afea6-5485-4013-8486-f36a3d592201 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 12:59:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] snapshot_file for this snap is: volume-639afea6-5485-4013-8486-f36a3d592201.5eeb17a6-ce73-43c0-aa2c-bb61b91d3254 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 12:59:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 12:59:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:59:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:59:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:59:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:59:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:59:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:04 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd312023-739c-4f41-aed2-bd49514e1af9]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:59:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201.5eeb17a6-ce73-43c0-aa2c-bb61b91d3254 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:04 devstack sudo[90232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:59:04 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:04 devstack sudo[90233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201.5eeb17a6-ce73-43c0-aa2c-bb61b91d3254
Nov 19 12:59:04 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:05 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.593s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:05 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:59:05 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201.5eeb17a6-ce73-43c0-aa2c-bb61b91d3254" returned: 0 in 0.840s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:05 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-639afea6-5485-4013-8486-f36a3d592201(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 12:59:05 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8362274b-d122-4654-8a0f-91c33285e5d6]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:59:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:05 devstack sudo[90252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201
Nov 19 12:59:05 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:06 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201" returned: 0 in 0.860s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201.5eeb17a6-ce73-43c0-aa2c-bb61b91d3254 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:06 devstack sudo[90358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201.5eeb17a6-ce73-43c0-aa2c-bb61b91d3254
Nov 19 12:59:06 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:07 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201.5eeb17a6-ce73-43c0-aa2c-bb61b91d3254" returned: 0 in 1.044s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201.5eeb17a6-ce73-43c0-aa2c-bb61b91d3254 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:07 devstack sudo[90371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201.5eeb17a6-ce73-43c0-aa2c-bb61b91d3254
Nov 19 12:59:07 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:07 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201.5eeb17a6-ce73-43c0-aa2c-bb61b91d3254" returned: 0 in 0.529s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:07 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-5eeb17a6-ce73-43c0-aa2c-bb61b91d3254" released by "_delete_snapshot" :: held 3.430s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:59:07 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-639afea6-5485-4013-8486-f36a3d592201" released by "delete_snapshot" :: held 3.443s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:59:07 devstack cinder-volume[80839]: WARNING cinder.quota [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-734427795 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-734427795, it is now deprecated. Please use the default quota class for default quota.
Nov 19 12:59:07 devstack cinder-volume[80839]: WARNING cinder.quota [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-734427795 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-734427795, it is now deprecated. Please use the default quota class for default quota.
Nov 19 12:59:07 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Created reservations ['4b63e82e-65f1-4769-b92c-fff369293d32', 'fb60f1b7-96a2-474d-8948-42f60d61a15b', 'e8e0baf2-9458-466f-b5e4-d12e3662763c', '376e75eb-7daa-4f16-a6ee-6589dae3ab99'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:59:08 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] Created reservations ['efd16242-5605-427a-a823-bb1b96eebd3f', '6b895dea-cf9d-4908-a036-2f9666403f45', 'f54794c9-71b1-47ab-92c7-4391f33a3b92', '63c7fff4-c353-4d77-aea5-c5b19349045e'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:59:08 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-63719004-c96e-4f99-9003-e89fd72d7dd7 tempest-GroupSnapshotsTest-1168928805 None] group_snapshot b00f35c3-1419-4c80-a887-26da018cd41e: deleted successfully
Nov 19 12:59:08 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-810ec1da-7b5b-4e15-aa0e-949d11f451b8 tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "cinder-quobyte-639afea6-5485-4013-8486-f36a3d592201" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:59:08 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-810ec1da-7b5b-4e15-aa0e-949d11f451b8 tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-639afea6-5485-4013-8486-f36a3d592201" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:59:08 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a26d322-0bdb-4b49-97e3-dcedfbf5e7a1]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:59:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-810ec1da-7b5b-4e15-aa0e-949d11f451b8 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:09 devstack sudo[90407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201
Nov 19 12:59:09 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:09 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-810ec1da-7b5b-4e15-aa0e-949d11f451b8 tempest-GroupSnapshotsTest-1168928805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201" returned: 0 in 0.792s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-810ec1da-7b5b-4e15-aa0e-949d11f451b8 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:09 devstack sudo[90414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201
Nov 19 12:59:09 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:10 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-810ec1da-7b5b-4e15-aa0e-949d11f451b8 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-639afea6-5485-4013-8486-f36a3d592201" returned: 0 in 0.698s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-810ec1da-7b5b-4e15-aa0e-949d11f451b8 tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-639afea6-5485-4013-8486-f36a3d592201" released by "delete_volume" :: held 1.579s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:59:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-810ec1da-7b5b-4e15-aa0e-949d11f451b8 tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "cinder-quobyte-a3c18534-ce6b-45e2-b448-17e4287da594" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:59:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-810ec1da-7b5b-4e15-aa0e-949d11f451b8 tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-a3c18534-ce6b-45e2-b448-17e4287da594" acquired by "delete_volume" :: waited 0.018s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:59:10 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[667730ce-0b93-4f02-b197-38abf4c89e83]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:59:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-810ec1da-7b5b-4e15-aa0e-949d11f451b8 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:10 devstack sudo[90418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594
Nov 19 12:59:10 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:11 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-810ec1da-7b5b-4e15-aa0e-949d11f451b8 tempest-GroupSnapshotsTest-1168928805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594" returned: 0 in 0.836s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-810ec1da-7b5b-4e15-aa0e-949d11f451b8 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:11 devstack sudo[90423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594
Nov 19 12:59:11 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:11 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-810ec1da-7b5b-4e15-aa0e-949d11f451b8 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a3c18534-ce6b-45e2-b448-17e4287da594" returned: 0 in 0.639s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:11 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-810ec1da-7b5b-4e15-aa0e-949d11f451b8 tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-a3c18534-ce6b-45e2-b448-17e4287da594" released by "delete_volume" :: held 1.520s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:59:11 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-810ec1da-7b5b-4e15-aa0e-949d11f451b8 tempest-GroupSnapshotsTest-1168928805 None] Created reservations ['f38eb1e4-2d88-481e-b5c9-dbf385838180'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:59:12 devstack cinder-volume[80839]: WARNING cinder.quota [None req-810ec1da-7b5b-4e15-aa0e-949d11f451b8 tempest-GroupSnapshotsTest-1168928805 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-734427795 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-734427795, it is now deprecated. Please use the default quota class for default quota.
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-810ec1da-7b5b-4e15-aa0e-949d11f451b8 tempest-GroupSnapshotsTest-1168928805 None] Created reservations ['9941f15c-862e-4dbb-a345-4267391a93de', 'f87b1d40-592d-4c72-8c09-bc5f5ef074db', 'b0cb507b-9c8e-4170-88a9-7acbb6ca3478', '9600c49a-3b0b-4510-b5d6-3b3dd0823c6c'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Flow 'volume_create_manager' (5ed6ab7e-30b9-4a50-acee-1c7297c6e3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff15aa18-2f1e-4701-bb1c-668756d6b236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff15aa18-2f1e-4701-bb1c-668756d6b236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-925554840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036399b6-86ab-420a-acc9-beb79c566c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f550a6352ba4c25a2854cc1bc2f63ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:59:12Z,use_quota=True,user_id='536527624e9348f1b1409ecfaef68ca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be60670d-2a39-4ae9-874f-18442a092810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be60670d-2a39-4ae9-874f-18442a092810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (230a6e41-6a90-45b8-b46c-e1aceb6f5de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (230a6e41-6a90-45b8-b46c-e1aceb6f5de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '036399b6-86ab-420a-acc9-beb79c566c89', 'volume_name': 'volume-036399b6-86ab-420a-acc9-beb79c566c89', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c045b0-eb19-4fd8-8e88-1fb10492aedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c045b0-eb19-4fd8-8e88-1fb10492aedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2289fa92-dba2-4eb7-aa6b-2e41729b73d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:59:12 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Volume 036399b6-86ab-420a-acc9-beb79c566c89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-036399b6-86ab-420a-acc9-beb79c566c89', 'volume_size': 1}
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-925554840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036399b6-86ab-420a-acc9-beb79c566c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f550a6352ba4c25a2854cc1bc2f63ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:59:12Z,use_quota=True,user_id='536527624e9348f1b1409ecfaef68ca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Creating volume 036399b6-86ab-420a-acc9-beb79c566c89 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:59:12 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:12 devstack sudo[90426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89 1073741824
Nov 19 12:59:12 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-810ec1da-7b5b-4e15-aa0e-949d11f451b8 tempest-GroupSnapshotsTest-1168928805 None] Created reservations ['0c80f133-aab3-4419-bb80-a536746d272c', '0d0a0b8e-38f0-4451-a2a5-a0e7bbcb5332', 'd18fa7cf-0f39-486c-ab2a-ca4f87e9564e', 'e933476a-6860-417f-837f-f941f7569363'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-810ec1da-7b5b-4e15-aa0e-949d11f451b8 tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-810ec1da-7b5b-4e15-aa0e-949d11f451b8 tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-810ec1da-7b5b-4e15-aa0e-949d11f451b8 tempest-GroupSnapshotsTest-1168928805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-810ec1da-7b5b-4e15-aa0e-949d11f451b8 tempest-GroupSnapshotsTest-1168928805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-810ec1da-7b5b-4e15-aa0e-949d11f451b8 tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:59:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-810ec1da-7b5b-4e15-aa0e-949d11f451b8 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:12 devstack sudo[90428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:59:12 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:13 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89 1073741824" returned: 0 in 0.804s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:13 devstack sudo[90437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89
Nov 19 12:59:13 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:13 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-810ec1da-7b5b-4e15-aa0e-949d11f451b8 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.793s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:13 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-810ec1da-7b5b-4e15-aa0e-949d11f451b8 tempest-GroupSnapshotsTest-1168928805 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:59:13 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-810ec1da-7b5b-4e15-aa0e-949d11f451b8 tempest-GroupSnapshotsTest-1168928805 None] Delete group completed successfully.
Nov 19 12:59:13 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-7aadcca8-6db0-48f9-b48b-69ddabc7b068 tempest-GroupSnapshotsTest-1168928805 None] Group tempest-GroupSnapshotsTest-Group-410636974: creating
Nov 19 12:59:13 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-7aadcca8-6db0-48f9-b48b-69ddabc7b068 tempest-GroupSnapshotsTest-1168928805 None] Group tempest-GroupSnapshotsTest-Group-410636974: created successfully
Nov 19 12:59:13 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-7aadcca8-6db0-48f9-b48b-69ddabc7b068 tempest-GroupSnapshotsTest-1168928805 None] Create group completed successfully.
Nov 19 12:59:13 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89" returned: 0 in 0.680s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:13 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:59:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:59:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2289fa92-dba2-4eb7-aa6b-2e41729b73d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-036399b6-86ab-420a-acc9-beb79c566c89', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:59:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aecc5e3-bbfe-4d46-958e-7fea97cfc595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:59:13 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Volume volume-036399b6-86ab-420a-acc9-beb79c566c89 (036399b6-86ab-420a-acc9-beb79c566c89): created successfully
Nov 19 12:59:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aecc5e3-bbfe-4d46-958e-7fea97cfc595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:59:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Flow 'volume_create_manager' (5ed6ab7e-30b9-4a50-acee-1c7297c6e3a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:59:13 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-da4e1356-1ef1-45f0-a506-708202a613bf tempest-TestStampPattern-1012733486 None] Created volume successfully.
Nov 19 12:59:14 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:59:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Flow 'volume_create_manager' (b7d95bb9-925b-46a8-be66-b4a4fdb389f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:59:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa0f851-9cb2-4b58-bf5f-799d886d4f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:59:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa0f851-9cb2-4b58-bf5f-799d886d4f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-717998130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=362fbe53-e7ff-46cf-b97c-569df96f7f76,host='devstack@QuobyteHD#QuobyteHD',id=858eed29-d26a-4728-8f95-8aaaf88503dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77693ecf98dc4996a10b471bb666c72a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:59:15Z,use_quota=True,user_id='0f7d1c27c9414547aa65aae31b449999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d255bfcd-e4d8-46a7-934f-ad99fe73b358),volume_type_id=d255bfcd-e4d8-46a7-934f-ad99fe73b358)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:59:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8aa60af-698e-49af-884b-3b0e077502d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:59:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8aa60af-698e-49af-884b-3b0e077502d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:59:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cacaf65-93ee-4684-b843-209a38a8142d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:59:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cacaf65-93ee-4684-b843-209a38a8142d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '858eed29-d26a-4728-8f95-8aaaf88503dc', 'volume_name': 'volume-858eed29-d26a-4728-8f95-8aaaf88503dc', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:59:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4c2a5d-3c17-4108-a84a-22b27d8b128c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:59:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4c2a5d-3c17-4108-a84a-22b27d8b128c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:59:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (439a9cd4-6e89-4869-8857-4e840bba6782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:59:15 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Volume 858eed29-d26a-4728-8f95-8aaaf88503dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-858eed29-d26a-4728-8f95-8aaaf88503dc', 'volume_size': 1}
Nov 19 12:59:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:59:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:59:15 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=362fbe53-e7ff-46cf-b97c-569df96f7f76,created_at=2025-11-19T11:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-717998130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=362fbe53-e7ff-46cf-b97c-569df96f7f76,host='devstack@QuobyteHD#QuobyteHD',id=858eed29-d26a-4728-8f95-8aaaf88503dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77693ecf98dc4996a10b471bb666c72a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:59:15Z,use_quota=True,user_id='0f7d1c27c9414547aa65aae31b449999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d255bfcd-e4d8-46a7-934f-ad99fe73b358),volume_type_id=d255bfcd-e4d8-46a7-934f-ad99fe73b358)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:59:15 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Creating volume 858eed29-d26a-4728-8f95-8aaaf88503dc {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:59:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:59:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:59:15 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:59:15 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:59:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:59:15 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:59:15 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:59:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:15 devstack sudo[90442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc 1073741824
Nov 19 12:59:15 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:15 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc 1073741824" returned: 0 in 0.695s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:15 devstack sudo[90447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc
Nov 19 12:59:15 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:16 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc" returned: 0 in 0.519s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:16 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:59:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:59:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (439a9cd4-6e89-4869-8857-4e840bba6782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-858eed29-d26a-4728-8f95-8aaaf88503dc', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:59:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3646045-69f4-49f7-8791-272c78b78757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:59:16 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Volume volume-858eed29-d26a-4728-8f95-8aaaf88503dc (858eed29-d26a-4728-8f95-8aaaf88503dc): created successfully
Nov 19 12:59:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3646045-69f4-49f7-8791-272c78b78757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:59:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Flow 'volume_create_manager' (b7d95bb9-925b-46a8-be66-b4a4fdb389f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:59:16 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-5bd06473-4e6f-4f61-84ed-8d85a0402b1b tempest-GroupSnapshotsTest-1168928805 None] Created volume successfully.
Nov 19 12:59:17 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-f57e7302-fcac-4ead-ada6-c00a8ca737e7 tempest-GroupSnapshotsTest-1168928805 None] GroupSnapshot d532278f-5adf-4858-8ee3-58d0790268d2: creating.
Nov 19 12:59:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f57e7302-fcac-4ead-ada6-c00a8ca737e7 tempest-GroupSnapshotsTest-1168928805 None] Group snapshot d532278f-5adf-4858-8ee3-58d0790268d2: creating. {{(pid=80839) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4143}}
Nov 19 12:59:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f57e7302-fcac-4ead-ada6-c00a8ca737e7 tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:59:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f57e7302-fcac-4ead-ada6-c00a8ca737e7 tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:59:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-f57e7302-fcac-4ead-ada6-c00a8ca737e7 tempest-GroupSnapshotsTest-1168928805 None] Creating offline snapshot e615ba13-d944-4583-969c-9dfa6e2437c8 of volume 858eed29-d26a-4728-8f95-8aaaf88503dc {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 12:59:17 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6c2ac4-ae4a-4323-af3d-965ba9f7cbc4]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:59:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f57e7302-fcac-4ead-ada6-c00a8ca737e7 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:17 devstack sudo[90451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc
Nov 19 12:59:17 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:18 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f57e7302-fcac-4ead-ada6-c00a8ca737e7 tempest-GroupSnapshotsTest-1168928805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc" returned: 0 in 0.740s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f57e7302-fcac-4ead-ada6-c00a8ca737e7 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc.e615ba13-d944-4583-969c-9dfa6e2437c8 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:18 devstack sudo[90456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc.e615ba13-d944-4583-969c-9dfa6e2437c8 1G
Nov 19 12:59:18 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:18 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f57e7302-fcac-4ead-ada6-c00a8ca737e7 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc.e615ba13-d944-4583-969c-9dfa6e2437c8 1G" returned: 0 in 0.714s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f57e7302-fcac-4ead-ada6-c00a8ca737e7 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-858eed29-d26a-4728-8f95-8aaaf88503dc -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc.e615ba13-d944-4583-969c-9dfa6e2437c8 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:18 devstack sudo[90461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-858eed29-d26a-4728-8f95-8aaaf88503dc -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc.e615ba13-d944-4583-969c-9dfa6e2437c8
Nov 19 12:59:18 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:19 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f57e7302-fcac-4ead-ada6-c00a8ca737e7 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-858eed29-d26a-4728-8f95-8aaaf88503dc -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc.e615ba13-d944-4583-969c-9dfa6e2437c8" returned: 0 in 0.678s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:19 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-f57e7302-fcac-4ead-ada6-c00a8ca737e7 tempest-GroupSnapshotsTest-1168928805 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc.e615ba13-d944-4583-969c-9dfa6e2437c8 is being set with open permissions: ugo+rw: NotImplementedError
Nov 19 12:59:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f57e7302-fcac-4ead-ada6-c00a8ca737e7 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc.e615ba13-d944-4583-969c-9dfa6e2437c8 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:19 devstack sudo[90470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc.e615ba13-d944-4583-969c-9dfa6e2437c8
Nov 19 12:59:19 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:19 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f57e7302-fcac-4ead-ada6-c00a8ca737e7 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc.e615ba13-d944-4583-969c-9dfa6e2437c8" returned: 0 in 0.450s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f57e7302-fcac-4ead-ada6-c00a8ca737e7 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:19 devstack sudo[90485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc.info
Nov 19 12:59:19 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:20 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f57e7302-fcac-4ead-ada6-c00a8ca737e7 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc.info" returned: 0 in 0.552s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:20 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-f57e7302-fcac-4ead-ada6-c00a8ca737e7 tempest-GroupSnapshotsTest-1168928805 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 19 12:59:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f57e7302-fcac-4ead-ada6-c00a8ca737e7 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:20 devstack sudo[90491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc.info
Nov 19 12:59:20 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:20 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f57e7302-fcac-4ead-ada6-c00a8ca737e7 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc.info" returned: 0 in 0.446s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f57e7302-fcac-4ead-ada6-c00a8ca737e7 tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.620s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:59:20 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-f57e7302-fcac-4ead-ada6-c00a8ca737e7 tempest-GroupSnapshotsTest-1168928805 None] group_snapshot d532278f-5adf-4858-8ee3-58d0790268d2: created successfully
Nov 19 12:59:21 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-23abc538-aa52-434e-8fa9-e94be01bb970 tempest-GroupSnapshotsTest-1168928805 None] group_snapshot d532278f-5adf-4858-8ee3-58d0790268d2: deleting
Nov 19 12:59:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-23abc538-aa52-434e-8fa9-e94be01bb970 tempest-GroupSnapshotsTest-1168928805 None] group_snapshot d532278f-5adf-4858-8ee3-58d0790268d2: deleting {{(pid=80839) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4318}}
Nov 19 12:59:21 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-23abc538-aa52-434e-8fa9-e94be01bb970 tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "cinder-quobyte-858eed29-d26a-4728-8f95-8aaaf88503dc" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:59:21 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-23abc538-aa52-434e-8fa9-e94be01bb970 tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-858eed29-d26a-4728-8f95-8aaaf88503dc" acquired by "delete_snapshot" :: waited 0.017s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:59:21 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-23abc538-aa52-434e-8fa9-e94be01bb970 tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "cinder-quobyte-e615ba13-d944-4583-969c-9dfa6e2437c8" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:59:21 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-23abc538-aa52-434e-8fa9-e94be01bb970 tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-e615ba13-d944-4583-969c-9dfa6e2437c8" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:59:21 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-23abc538-aa52-434e-8fa9-e94be01bb970 tempest-GroupSnapshotsTest-1168928805 None] Deleting offline snapshot e615ba13-d944-4583-969c-9dfa6e2437c8 of volume 858eed29-d26a-4728-8f95-8aaaf88503dc {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 12:59:21 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-23abc538-aa52-434e-8fa9-e94be01bb970 tempest-GroupSnapshotsTest-1168928805 None] snapshot_file for this snap is: volume-858eed29-d26a-4728-8f95-8aaaf88503dc.e615ba13-d944-4583-969c-9dfa6e2437c8 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 12:59:21 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[819a7835-fbe4-4c12-aaac-07e9cdc5daa3]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:59:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-23abc538-aa52-434e-8fa9-e94be01bb970 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc.e615ba13-d944-4583-969c-9dfa6e2437c8 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-874e9470-cc16-4567-804a-e4a72ae54c9a req-b80b834e-939f-4411-bf37-c02c981fb396 tempest-AttachVolumeShelveTestJSON-1725620549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:59:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-874e9470-cc16-4567-804a-e4a72ae54c9a req-b80b834e-939f-4411-bf37-c02c981fb396 tempest-AttachVolumeShelveTestJSON-1725620549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:59:21 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f2dc90-5463-4a18-ab7b-90af3dc80568]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:59:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-874e9470-cc16-4567-804a-e4a72ae54c9a req-b80b834e-939f-4411-bf37-c02c981fb396 tempest-AttachVolumeShelveTestJSON-1725620549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7e2321bf-4965-464a-86bc-2ef7696e40e7 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:21 devstack sudo[90502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc.e615ba13-d944-4583-969c-9dfa6e2437c8
Nov 19 12:59:21 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:21 devstack sudo[90503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7e2321bf-4965-464a-86bc-2ef7696e40e7
Nov 19 12:59:21 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:22 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-23abc538-aa52-434e-8fa9-e94be01bb970 tempest-GroupSnapshotsTest-1168928805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc.e615ba13-d944-4583-969c-9dfa6e2437c8" returned: 0 in 0.636s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:22 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-23abc538-aa52-434e-8fa9-e94be01bb970 tempest-GroupSnapshotsTest-1168928805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-858eed29-d26a-4728-8f95-8aaaf88503dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 12:59:22 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13b2fc4-4e9d-4f43-99e5-0e172998a916]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:59:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-23abc538-aa52-434e-8fa9-e94be01bb970 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:22 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-874e9470-cc16-4567-804a-e4a72ae54c9a req-b80b834e-939f-4411-bf37-c02c981fb396 tempest-AttachVolumeShelveTestJSON-1725620549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7e2321bf-4965-464a-86bc-2ef7696e40e7" returned: 0 in 0.593s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-874e9470-cc16-4567-804a-e4a72ae54c9a req-b80b834e-939f-4411-bf37-c02c981fb396 tempest-AttachVolumeShelveTestJSON-1725620549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.603s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:59:22 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-874e9470-cc16-4567-804a-e4a72ae54c9a req-b80b834e-939f-4411-bf37-c02c981fb396 tempest-AttachVolumeShelveTestJSON-1725620549 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-7e2321bf-4965-464a-86bc-2ef7696e40e7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c4bdf450-9a97-4b9d-8588-90d946dbf31a', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 12:59:22 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-874e9470-cc16-4567-804a-e4a72ae54c9a req-b80b834e-939f-4411-bf37-c02c981fb396 tempest-AttachVolumeShelveTestJSON-1725620549 None] attachment_update completed successfully.
Nov 19 12:59:22 devstack sudo[90512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc
Nov 19 12:59:22 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:23 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-23abc538-aa52-434e-8fa9-e94be01bb970 tempest-GroupSnapshotsTest-1168928805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc" returned: 0 in 0.615s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-23abc538-aa52-434e-8fa9-e94be01bb970 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc.e615ba13-d944-4583-969c-9dfa6e2437c8 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:23 devstack sudo[90521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc.e615ba13-d944-4583-969c-9dfa6e2437c8
Nov 19 12:59:23 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:23 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-23abc538-aa52-434e-8fa9-e94be01bb970 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc.e615ba13-d944-4583-969c-9dfa6e2437c8" returned: 0 in 0.504s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-23abc538-aa52-434e-8fa9-e94be01bb970 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc.e615ba13-d944-4583-969c-9dfa6e2437c8 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:23 devstack sudo[90526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc.e615ba13-d944-4583-969c-9dfa6e2437c8
Nov 19 12:59:23 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:24 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-23abc538-aa52-434e-8fa9-e94be01bb970 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc.e615ba13-d944-4583-969c-9dfa6e2437c8" returned: 0 in 0.530s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-23abc538-aa52-434e-8fa9-e94be01bb970 tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-e615ba13-d944-4583-969c-9dfa6e2437c8" released by "_delete_snapshot" :: held 2.391s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:59:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-23abc538-aa52-434e-8fa9-e94be01bb970 tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-858eed29-d26a-4728-8f95-8aaaf88503dc" released by "delete_snapshot" :: held 2.408s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:59:24 devstack cinder-volume[80839]: WARNING cinder.quota [None req-23abc538-aa52-434e-8fa9-e94be01bb970 tempest-GroupSnapshotsTest-1168928805 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-927767999 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-927767999, it is now deprecated. Please use the default quota class for default quota.
Nov 19 12:59:24 devstack cinder-volume[80839]: WARNING cinder.quota [None req-23abc538-aa52-434e-8fa9-e94be01bb970 tempest-GroupSnapshotsTest-1168928805 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-927767999 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-927767999, it is now deprecated. Please use the default quota class for default quota.
Nov 19 12:59:24 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-23abc538-aa52-434e-8fa9-e94be01bb970 tempest-GroupSnapshotsTest-1168928805 None] Created reservations ['35b41fcf-d750-4f6b-b022-fdb8ad73a5f6', 'ae220138-05b3-476e-aab0-709b57db88fb', '472a4344-ea83-4051-a48e-5cf785da2504', '5838c690-41fb-47c5-be66-28c44ccb375d'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:59:24 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-23abc538-aa52-434e-8fa9-e94be01bb970 tempest-GroupSnapshotsTest-1168928805 None] group_snapshot d532278f-5adf-4858-8ee3-58d0790268d2: deleted successfully
Nov 19 12:59:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-940d4985-38fc-4b8c-b788-9db99dcca631 tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "cinder-quobyte-858eed29-d26a-4728-8f95-8aaaf88503dc" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 12:59:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-940d4985-38fc-4b8c-b788-9db99dcca631 tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-858eed29-d26a-4728-8f95-8aaaf88503dc" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 12:59:25 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2148b6d8-ccac-4be2-bc6d-3f5d128e85a5]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 12:59:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-940d4985-38fc-4b8c-b788-9db99dcca631 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:25 devstack sudo[90591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc
Nov 19 12:59:25 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:26 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-940d4985-38fc-4b8c-b788-9db99dcca631 tempest-GroupSnapshotsTest-1168928805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc" returned: 0 in 0.568s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-940d4985-38fc-4b8c-b788-9db99dcca631 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:26 devstack sudo[90596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc
Nov 19 12:59:26 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:26 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-940d4985-38fc-4b8c-b788-9db99dcca631 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-858eed29-d26a-4728-8f95-8aaaf88503dc" returned: 0 in 0.675s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-940d4985-38fc-4b8c-b788-9db99dcca631 tempest-GroupSnapshotsTest-1168928805 None] Lock "cinder-quobyte-858eed29-d26a-4728-8f95-8aaaf88503dc" released by "delete_volume" :: held 1.344s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 12:59:26 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-940d4985-38fc-4b8c-b788-9db99dcca631 tempest-GroupSnapshotsTest-1168928805 None] Created reservations ['4e3dbdf7-4372-4437-8f0b-3c6ac8bda880'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:59:26 devstack cinder-volume[80839]: WARNING cinder.quota [None req-940d4985-38fc-4b8c-b788-9db99dcca631 tempest-GroupSnapshotsTest-1168928805 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-927767999 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-927767999, it is now deprecated. Please use the default quota class for default quota.
Nov 19 12:59:26 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-940d4985-38fc-4b8c-b788-9db99dcca631 tempest-GroupSnapshotsTest-1168928805 None] Created reservations ['25fd4d08-a6af-46d0-afc2-4b58352fb0cc', '894b4ccc-0197-4389-85d6-84c4f724c764', '767bac81-30db-4561-8386-f450efa9979d', 'e343b0f1-c525-4f8a-a1f4-aeae7fd76d30'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 12:59:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-940d4985-38fc-4b8c-b788-9db99dcca631 tempest-GroupSnapshotsTest-1168928805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:59:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-940d4985-38fc-4b8c-b788-9db99dcca631 tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:59:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-940d4985-38fc-4b8c-b788-9db99dcca631 tempest-GroupSnapshotsTest-1168928805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:59:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-940d4985-38fc-4b8c-b788-9db99dcca631 tempest-GroupSnapshotsTest-1168928805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:59:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-940d4985-38fc-4b8c-b788-9db99dcca631 tempest-GroupSnapshotsTest-1168928805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:59:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-940d4985-38fc-4b8c-b788-9db99dcca631 tempest-GroupSnapshotsTest-1168928805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:27 devstack sudo[90599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 12:59:27 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:27 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-940d4985-38fc-4b8c-b788-9db99dcca631 tempest-GroupSnapshotsTest-1168928805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.504s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:27 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-940d4985-38fc-4b8c-b788-9db99dcca631 tempest-GroupSnapshotsTest-1168928805 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 12:59:27 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-940d4985-38fc-4b8c-b788-9db99dcca631 tempest-GroupSnapshotsTest-1168928805 None] Delete group completed successfully.
Nov 19 12:59:36 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=107,cinder:UPDATE=106,cinder:INSERT=25,cinder:DELETE=3 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:59:36 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=116,cinder:INSERT=19,cinder:UPDATE=106,cinder:DELETE=3 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 12:59:58 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 12:59:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Flow 'volume_create_manager' (d5133fac-040b-40ea-aff4-f4c431d86dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:59:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85cb93e8-ad11-42b2-ba44-708aa78fd3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:59:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85cb93e8-ad11-42b2-ba44-708aa78fd3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1823766550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ceada1e-c27b-4d11-a027-3483416d39c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9235e114f3b841409c6bde7d73530b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:59:58Z,use_quota=True,user_id='ebba3f71af8e4e3f948fc2d6f3a19946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:59:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (035a5223-3c51-420b-9322-3d97335192c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:59:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (035a5223-3c51-420b-9322-3d97335192c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:59:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c5f8ce-3ea2-48ed-874e-f26ef72617d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:59:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c5f8ce-3ea2-48ed-874e-f26ef72617d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ceada1e-c27b-4d11-a027-3483416d39c5', 'volume_name': 'volume-7ceada1e-c27b-4d11-a027-3483416d39c5', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:59:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (152d943f-5d07-4fae-a127-7a6abfa63a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:59:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (152d943f-5d07-4fae-a127-7a6abfa63a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:59:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73291ff1-adc1-4b62-9ac8-634cc04ca7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:59:58 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Volume 7ceada1e-c27b-4d11-a027-3483416d39c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ceada1e-c27b-4d11-a027-3483416d39c5', 'volume_size': 1}
Nov 19 12:59:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:59:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:59:58 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T11:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1823766550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ceada1e-c27b-4d11-a027-3483416d39c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9235e114f3b841409c6bde7d73530b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T11:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T11:59:58Z,use_quota=True,user_id='ebba3f71af8e4e3f948fc2d6f3a19946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 12:59:58 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Creating volume 7ceada1e-c27b-4d11-a027-3483416d39c5 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 12:59:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 12:59:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 12:59:58 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 12:59:58 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 12:59:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:59:58 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 12:59:58 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 12:59:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:58 devstack sudo[90833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5 1073741824
Nov 19 12:59:58 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:59 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5 1073741824" returned: 0 in 0.562s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 12:59:59 devstack sudo[90838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5
Nov 19 12:59:59 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 12:59:59 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root
Nov 19 12:59:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5" returned: 0 in 0.483s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 12:59:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 12:59:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 12:59:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73291ff1-adc1-4b62-9ac8-634cc04ca7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ceada1e-c27b-4d11-a027-3483416d39c5', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:59:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a612ad74-edf7-4973-8bb3-0e6b53ca818a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 12:59:59 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Volume volume-7ceada1e-c27b-4d11-a027-3483416d39c5 (7ceada1e-c27b-4d11-a027-3483416d39c5): created successfully
Nov 19 12:59:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a612ad74-edf7-4973-8bb3-0e6b53ca818a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 12:59:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Flow 'volume_create_manager' (d5133fac-040b-40ea-aff4-f4c431d86dd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 12:59:59 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-e9725b1c-4327-4647-b55f-502cae47c69c tempest-VolumesActionsTest-296704052 None] Created volume successfully.
Nov 19 13:00:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 13:00:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:00:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:00:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:00:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:00:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:00:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:00:04 devstack sudo[90847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:00:04 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:00:04 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root
Nov 19 13:00:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.433s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:00:04 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:00:09 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:00:09 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:00:14 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-229de254-b4d9-42a5-be34-a6c58e222ddc tempest-VolumesActionsTest-296704052 None] Acquiring lock "cinder-7ceada1e-c27b-4d11-a027-3483416d39c5" by "attach_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:00:14 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-229de254-b4d9-42a5-be34-a6c58e222ddc tempest-VolumesActionsTest-296704052 None] Lock "cinder-7ceada1e-c27b-4d11-a027-3483416d39c5" acquired by "attach_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:00:14 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-229de254-b4d9-42a5-be34-a6c58e222ddc tempest-VolumesActionsTest-296704052 None] Attaching volume 7ceada1e-c27b-4d11-a027-3483416d39c5 to instance 749fd2e4-d361-4cf2-a056-9d4a3ea597a6 at mountpoint /dev/vdb on host None.
Nov 19 13:00:14 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-229de254-b4d9-42a5-be34-a6c58e222ddc tempest-VolumesActionsTest-296704052 None] Attach volume completed successfully.
Nov 19 13:00:14 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-229de254-b4d9-42a5-be34-a6c58e222ddc tempest-VolumesActionsTest-296704052 None] Lock "cinder-7ceada1e-c27b-4d11-a027-3483416d39c5" released by "attach_volume" :: held 0.075s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:00:14 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-9c39c37d-6bba-4843-9d41-09e9341b3489 req-b52f361d-ee0e-4ea0-8b3c-fa3cc95825b8 tempest-ServerRescueNegativeTestJSON-79025645 None] Terminate volume connection completed successfully.
Nov 19 13:00:14 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-9c39c37d-6bba-4843-9d41-09e9341b3489 req-b52f361d-ee0e-4ea0-8b3c-fa3cc95825b8 tempest-ServerRescueNegativeTestJSON-79025645 None] Deleting attachment 4347c080-cc97-4423-a5d7-5499a5f249c0. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 13:00:14 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9b688eef-1a54-437b-9a30-1fec6c3b3bce tempest-VolumesActionsTest-296704052 None] Acquiring lock "cinder-7ceada1e-c27b-4d11-a027-3483416d39c5-detach_volume" by "detach_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:00:14 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9b688eef-1a54-437b-9a30-1fec6c3b3bce tempest-VolumesActionsTest-296704052 None] Lock "cinder-7ceada1e-c27b-4d11-a027-3483416d39c5-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:00:14 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-9b688eef-1a54-437b-9a30-1fec6c3b3bce tempest-VolumesActionsTest-296704052 None] Detaching volume 7ceada1e-c27b-4d11-a027-3483416d39c5 from instance 749fd2e4-d361-4cf2-a056-9d4a3ea597a6.
Nov 19 13:00:14 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-9b688eef-1a54-437b-9a30-1fec6c3b3bce tempest-VolumesActionsTest-296704052 None] Detach volume completed successfully.
Nov 19 13:00:14 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9b688eef-1a54-437b-9a30-1fec6c3b3bce tempest-VolumesActionsTest-296704052 None] Lock "cinder-7ceada1e-c27b-4d11-a027-3483416d39c5-detach_volume" released by "detach_volume" :: held 0.041s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:00:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-96dfedca-0de5-429c-a5b7-769c6bfb6971 tempest-ServerRescueNegativeTestJSON-79025645 None] Acquiring lock "cinder-d4513d94-d757-4df6-8886-a8c37ae19bc3-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:00:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-96dfedca-0de5-429c-a5b7-769c6bfb6971 tempest-ServerRescueNegativeTestJSON-79025645 None] Lock "cinder-d4513d94-d757-4df6-8886-a8c37ae19bc3-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:00:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-96dfedca-0de5-429c-a5b7-769c6bfb6971 tempest-ServerRescueNegativeTestJSON-79025645 None] Acquiring lock "cinder-quobyte-d4513d94-d757-4df6-8886-a8c37ae19bc3" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:00:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-96dfedca-0de5-429c-a5b7-769c6bfb6971 tempest-ServerRescueNegativeTestJSON-79025645 None] Lock "cinder-quobyte-d4513d94-d757-4df6-8886-a8c37ae19bc3" acquired by "delete_volume" :: waited 0.024s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:00:24 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e83d7c7-f810-4a9d-aec3-420989e82b43]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:00:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-96dfedca-0de5-429c-a5b7-769c6bfb6971 tempest-ServerRescueNegativeTestJSON-79025645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d4513d94-d757-4df6-8886-a8c37ae19bc3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:00:25 devstack sudo[91040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d4513d94-d757-4df6-8886-a8c37ae19bc3
Nov 19 13:00:25 devstack sudo[91040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:00:25 devstack sudo[91040]: pam_unix(sudo:session): session closed for user root
Nov 19 13:00:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-96dfedca-0de5-429c-a5b7-769c6bfb6971 tempest-ServerRescueNegativeTestJSON-79025645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d4513d94-d757-4df6-8886-a8c37ae19bc3" returned: 0 in 0.722s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:00:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-96dfedca-0de5-429c-a5b7-769c6bfb6971 tempest-ServerRescueNegativeTestJSON-79025645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d4513d94-d757-4df6-8886-a8c37ae19bc3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:00:25 devstack sudo[91048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d4513d94-d757-4df6-8886-a8c37ae19bc3
Nov 19 13:00:25 devstack sudo[91048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:00:26 devstack sudo[91048]: pam_unix(sudo:session): session closed for user root
Nov 19 13:00:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-96dfedca-0de5-429c-a5b7-769c6bfb6971 tempest-ServerRescueNegativeTestJSON-79025645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d4513d94-d757-4df6-8886-a8c37ae19bc3" returned: 0 in 0.628s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:00:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-96dfedca-0de5-429c-a5b7-769c6bfb6971 tempest-ServerRescueNegativeTestJSON-79025645 None] Lock "cinder-quobyte-d4513d94-d757-4df6-8886-a8c37ae19bc3" released by "delete_volume" :: held 1.383s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:00:26 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-96dfedca-0de5-429c-a5b7-769c6bfb6971 tempest-ServerRescueNegativeTestJSON-79025645 None] Created reservations ['83d3fabf-c132-4291-a44b-ccfc5a9f659a', '920d00da-38db-4bdf-8f99-1e015ac9eae2', 'c13dae35-cb74-4fb7-8e98-3bc23a187b80', '7b6b8af1-8a42-4970-961b-ddd7a04082f5'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:00:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-96dfedca-0de5-429c-a5b7-769c6bfb6971 tempest-ServerRescueNegativeTestJSON-79025645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:00:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-96dfedca-0de5-429c-a5b7-769c6bfb6971 tempest-ServerRescueNegativeTestJSON-79025645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:00:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-96dfedca-0de5-429c-a5b7-769c6bfb6971 tempest-ServerRescueNegativeTestJSON-79025645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:00:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-96dfedca-0de5-429c-a5b7-769c6bfb6971 tempest-ServerRescueNegativeTestJSON-79025645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:00:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-96dfedca-0de5-429c-a5b7-769c6bfb6971 tempest-ServerRescueNegativeTestJSON-79025645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:00:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-96dfedca-0de5-429c-a5b7-769c6bfb6971 tempest-ServerRescueNegativeTestJSON-79025645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:00:26 devstack sudo[91053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:00:26 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:00:26 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root
Nov 19 13:00:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-96dfedca-0de5-429c-a5b7-769c6bfb6971 tempest-ServerRescueNegativeTestJSON-79025645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.524s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:00:26 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-96dfedca-0de5-429c-a5b7-769c6bfb6971 tempest-ServerRescueNegativeTestJSON-79025645 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:00:26 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-96dfedca-0de5-429c-a5b7-769c6bfb6971 tempest-ServerRescueNegativeTestJSON-79025645 None] Deleted volume successfully.
Nov 19 13:00:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-96dfedca-0de5-429c-a5b7-769c6bfb6971 tempest-ServerRescueNegativeTestJSON-79025645 None] Lock "cinder-d4513d94-d757-4df6-8886-a8c37ae19bc3-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:00:27 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-2c6a39a8-fed7-4df4-9029-797eb7cb0805 tempest-ServerRescueNegativeTestJSON-79025645 None] Acquiring lock "cinder-35de9b51-3942-4bf7-b6b2-d01abc591daf-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:00:27 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-2c6a39a8-fed7-4df4-9029-797eb7cb0805 tempest-ServerRescueNegativeTestJSON-79025645 None] Lock "cinder-35de9b51-3942-4bf7-b6b2-d01abc591daf-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:00:27 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-2c6a39a8-fed7-4df4-9029-797eb7cb0805 tempest-ServerRescueNegativeTestJSON-79025645 None] Acquiring lock "cinder-quobyte-35de9b51-3942-4bf7-b6b2-d01abc591daf" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:00:27 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-2c6a39a8-fed7-4df4-9029-797eb7cb0805 tempest-ServerRescueNegativeTestJSON-79025645 None] Lock "cinder-quobyte-35de9b51-3942-4bf7-b6b2-d01abc591daf" acquired by "delete_volume" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:00:27 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7dca36-4104-4330-ab07-d8790f0bea0e]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:00:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2c6a39a8-fed7-4df4-9029-797eb7cb0805 tempest-ServerRescueNegativeTestJSON-79025645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-35de9b51-3942-4bf7-b6b2-d01abc591daf {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:00:27 devstack sudo[91056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-35de9b51-3942-4bf7-b6b2-d01abc591daf
Nov 19 13:00:27 devstack sudo[91056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:00:27 devstack sudo[91056]: pam_unix(sudo:session): session closed for user root
Nov 19 13:00:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2c6a39a8-fed7-4df4-9029-797eb7cb0805 tempest-ServerRescueNegativeTestJSON-79025645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-35de9b51-3942-4bf7-b6b2-d01abc591daf" returned: 0 in 0.686s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:00:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2c6a39a8-fed7-4df4-9029-797eb7cb0805 tempest-ServerRescueNegativeTestJSON-79025645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-35de9b51-3942-4bf7-b6b2-d01abc591daf {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:00:27 devstack sudo[91061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-35de9b51-3942-4bf7-b6b2-d01abc591daf
Nov 19 13:00:27 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:00:28 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root
Nov 19 13:00:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2c6a39a8-fed7-4df4-9029-797eb7cb0805 tempest-ServerRescueNegativeTestJSON-79025645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-35de9b51-3942-4bf7-b6b2-d01abc591daf" returned: 0 in 0.551s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:00:28 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-2c6a39a8-fed7-4df4-9029-797eb7cb0805 tempest-ServerRescueNegativeTestJSON-79025645 None] Lock "cinder-quobyte-35de9b51-3942-4bf7-b6b2-d01abc591daf" released by "delete_volume" :: held 1.307s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:00:28 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-2c6a39a8-fed7-4df4-9029-797eb7cb0805 tempest-ServerRescueNegativeTestJSON-79025645 None] Created reservations ['9ba83362-8ab0-4cfe-8e69-2b3c9dee47be', '91a1b012-0a7a-404a-9004-2c4d23734197', 'cd82bc3d-7f20-4a2f-be04-06595fc447c4', '8ab07001-6d3c-4d02-9d1f-f55008850388'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:00:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2c6a39a8-fed7-4df4-9029-797eb7cb0805 tempest-ServerRescueNegativeTestJSON-79025645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:00:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2c6a39a8-fed7-4df4-9029-797eb7cb0805 tempest-ServerRescueNegativeTestJSON-79025645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:00:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-2c6a39a8-fed7-4df4-9029-797eb7cb0805 tempest-ServerRescueNegativeTestJSON-79025645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:00:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-2c6a39a8-fed7-4df4-9029-797eb7cb0805 tempest-ServerRescueNegativeTestJSON-79025645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:00:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2c6a39a8-fed7-4df4-9029-797eb7cb0805 tempest-ServerRescueNegativeTestJSON-79025645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:00:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2c6a39a8-fed7-4df4-9029-797eb7cb0805 tempest-ServerRescueNegativeTestJSON-79025645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:00:28 devstack sudo[91065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:00:28 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:00:28 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root
Nov 19 13:00:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2c6a39a8-fed7-4df4-9029-797eb7cb0805 tempest-ServerRescueNegativeTestJSON-79025645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.504s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:00:28 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-2c6a39a8-fed7-4df4-9029-797eb7cb0805 tempest-ServerRescueNegativeTestJSON-79025645 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:00:28 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-2c6a39a8-fed7-4df4-9029-797eb7cb0805 tempest-ServerRescueNegativeTestJSON-79025645 None] Deleted volume successfully.
Nov 19 13:00:29 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-2c6a39a8-fed7-4df4-9029-797eb7cb0805 tempest-ServerRescueNegativeTestJSON-79025645 None] Lock "cinder-35de9b51-3942-4bf7-b6b2-d01abc591daf-delete_volume" released by "delete_volume" :: held 1.993s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:00:36 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-4955d903-ed2c-4cea-bfa8-92a91b03101b tempest-VolumesActionsTest-296704052 None] Acquiring lock "cinder-7ceada1e-c27b-4d11-a027-3483416d39c5" by "attach_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:00:36 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-4955d903-ed2c-4cea-bfa8-92a91b03101b tempest-VolumesActionsTest-296704052 None] Lock "cinder-7ceada1e-c27b-4d11-a027-3483416d39c5" acquired by "attach_volume" :: waited 0.012s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:00:36 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-4955d903-ed2c-4cea-bfa8-92a91b03101b tempest-VolumesActionsTest-296704052 None] Attaching volume 7ceada1e-c27b-4d11-a027-3483416d39c5 to instance fddb9102-4e0c-4ac0-8fdb-372baf00f2dc at mountpoint /dev/vdb on host None.
Nov 19 13:00:37 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-4955d903-ed2c-4cea-bfa8-92a91b03101b tempest-VolumesActionsTest-296704052 None] Attach volume completed successfully.
Nov 19 13:00:37 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-4955d903-ed2c-4cea-bfa8-92a91b03101b tempest-VolumesActionsTest-296704052 None] Lock "cinder-7ceada1e-c27b-4d11-a027-3483416d39c5" released by "attach_volume" :: held 0.599s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:00:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-a2e90378-933a-4c41-8744-c288bdcb077b req-32e825c7-f259-4167-b87b-d7645ff96dd3 tempest-TestStampPattern-1012733486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:00:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-a2e90378-933a-4c41-8744-c288bdcb077b req-32e825c7-f259-4167-b87b-d7645ff96dd3 tempest-TestStampPattern-1012733486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:00:37 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41f0cf0-7a19-4947-9b0e-c9e88e9fa92a]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:00:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-a2e90378-933a-4c41-8744-c288bdcb077b req-32e825c7-f259-4167-b87b-d7645ff96dd3 tempest-TestStampPattern-1012733486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:00:37 devstack sudo[91264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89
Nov 19 13:00:37 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:00:38 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-e9007e19-94b3-4c91-9e15-88b1c4c5a58d tempest-VolumesActionsTest-296704052 None] Acquiring lock "cinder-7ceada1e-c27b-4d11-a027-3483416d39c5-detach_volume" by "detach_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:00:38 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-e9007e19-94b3-4c91-9e15-88b1c4c5a58d tempest-VolumesActionsTest-296704052 None] Lock "cinder-7ceada1e-c27b-4d11-a027-3483416d39c5-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:00:38 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-e9007e19-94b3-4c91-9e15-88b1c4c5a58d tempest-VolumesActionsTest-296704052 None] Detaching volume 7ceada1e-c27b-4d11-a027-3483416d39c5 from instance fddb9102-4e0c-4ac0-8fdb-372baf00f2dc.
Nov 19 13:00:38 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root
Nov 19 13:00:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-a2e90378-933a-4c41-8744-c288bdcb077b req-32e825c7-f259-4167-b87b-d7645ff96dd3 tempest-TestStampPattern-1012733486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89" returned: 0 in 0.684s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:00:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-a2e90378-933a-4c41-8744-c288bdcb077b req-32e825c7-f259-4167-b87b-d7645ff96dd3 tempest-TestStampPattern-1012733486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.702s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:00:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-a2e90378-933a-4c41-8744-c288bdcb077b req-32e825c7-f259-4167-b87b-d7645ff96dd3 tempest-TestStampPattern-1012733486 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-036399b6-86ab-420a-acc9-beb79c566c89', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '87a1e908-d674-4519-80a4-fd91f32b1976', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 13:00:39 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-e9007e19-94b3-4c91-9e15-88b1c4c5a58d tempest-VolumesActionsTest-296704052 None] Detach volume completed successfully.
Nov 19 13:00:39 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-a2e90378-933a-4c41-8744-c288bdcb077b req-32e825c7-f259-4167-b87b-d7645ff96dd3 tempest-TestStampPattern-1012733486 None] attachment_update completed successfully.
Nov 19 13:00:39 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-e9007e19-94b3-4c91-9e15-88b1c4c5a58d tempest-VolumesActionsTest-296704052 None] Lock "cinder-7ceada1e-c27b-4d11-a027-3483416d39c5-detach_volume" released by "detach_volume" :: held 0.964s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:00:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1e9a9dec-e7a8-43ca-9ece-45c446b8758d tempest-VolumesActionsTest-296704052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:00:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1e9a9dec-e7a8-43ca-9ece-45c446b8758d tempest-VolumesActionsTest-296704052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:00:47 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[19db07bb-ec6b-4e95-b8fb-2912cee4a18c]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:00:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1e9a9dec-e7a8-43ca-9ece-45c446b8758d tempest-VolumesActionsTest-296704052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:00:47 devstack sudo[91415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5
Nov 19 13:00:47 devstack sudo[91415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:00:48 devstack sudo[91415]: pam_unix(sudo:session): session closed for user root
Nov 19 13:00:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1e9a9dec-e7a8-43ca-9ece-45c446b8758d tempest-VolumesActionsTest-296704052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5" returned: 0 in 0.667s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:00:48 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4daa5ce2-653f-4885-885f-7bbff935d9e2]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:00:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1e9a9dec-e7a8-43ca-9ece-45c446b8758d tempest-VolumesActionsTest-296704052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:00:48 devstack sudo[91422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5
Nov 19 13:00:48 devstack sudo[91422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:00:48 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-05222eef-8fc8-43ec-9d0f-0fa68e940e1c req-3717b449-070a-4644-a4d2-84795d7a1e87 tempest-AttachVolumeShelveTestJSON-1725620549 None] Terminate volume connection completed successfully.
Nov 19 13:00:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-05222eef-8fc8-43ec-9d0f-0fa68e940e1c req-3717b449-070a-4644-a4d2-84795d7a1e87 tempest-AttachVolumeShelveTestJSON-1725620549 None] Deleting attachment c4bdf450-9a97-4b9d-8588-90d946dbf31a. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 13:00:48 devstack sudo[91422]: pam_unix(sudo:session): session closed for user root
Nov 19 13:00:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1e9a9dec-e7a8-43ca-9ece-45c446b8758d tempest-VolumesActionsTest-296704052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5" returned: 0 in 0.747s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:00:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1e9a9dec-e7a8-43ca-9ece-45c446b8758d tempest-VolumesActionsTest-296704052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5 /opt/stack/data/cinder/conversion/7ceada1e-c27b-4d11-a027-3483416d39c5.temp_image.75347da8-ac14-4d65-832d-b26ff7464045vbwjfu8o.img {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:00:48 devstack sudo[91429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5 /opt/stack/data/cinder/conversion/7ceada1e-c27b-4d11-a027-3483416d39c5.temp_image.75347da8-ac14-4d65-832d-b26ff7464045vbwjfu8o.img
Nov 19 13:00:48 devstack sudo[91429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:00:51 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-a741e8ea-5346-4c8f-a709-b9ff4eb55823 req-1a75b9e3-98d5-4fe3-b266-7dc9a32c207d tempest-TestStampPattern-1012733486 None] Terminate volume connection completed successfully.
Nov 19 13:00:51 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-a741e8ea-5346-4c8f-a709-b9ff4eb55823 req-1a75b9e3-98d5-4fe3-b266-7dc9a32c207d tempest-TestStampPattern-1012733486 None] Deleting attachment 87a1e908-d674-4519-80a4-fd91f32b1976. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 13:00:51 devstack sudo[91429]: pam_unix(sudo:session): session closed for user root
Nov 19 13:00:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1e9a9dec-e7a8-43ca-9ece-45c446b8758d tempest-VolumesActionsTest-296704052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5 /opt/stack/data/cinder/conversion/7ceada1e-c27b-4d11-a027-3483416d39c5.temp_image.75347da8-ac14-4d65-832d-b26ff7464045vbwjfu8o.img" returned: 0 in 2.469s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:00:51 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[74289776-35ae-4746-a4fb-e9543a4a6ca8]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:00:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1e9a9dec-e7a8-43ca-9ece-45c446b8758d tempest-VolumesActionsTest-296704052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:00:51 devstack sudo[91449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5
Nov 19 13:00:51 devstack sudo[91449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:00:52 devstack sudo[91449]: pam_unix(sudo:session): session closed for user root
Nov 19 13:00:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1e9a9dec-e7a8-43ca-9ece-45c446b8758d tempest-VolumesActionsTest-296704052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5" returned: 0 in 0.769s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:00:52 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-1e9a9dec-e7a8-43ca-9ece-45c446b8758d tempest-VolumesActionsTest-296704052 None] Image conversion details: src /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5, size 1024.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/conversion/7ceada1e-c27b-4d11-a027-3483416d39c5.temp_image.75347da8-ac14-4d65-832d-b26ff7464045vbwjfu8o.img {{(pid=80839) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 19 13:00:52 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-1e9a9dec-e7a8-43ca-9ece-45c446b8758d tempest-VolumesActionsTest-296704052 None] Converted 1024.00 MB image at 414.53 MB/s
Nov 19 13:00:52 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-1e9a9dec-e7a8-43ca-9ece-45c446b8758d tempest-VolumesActionsTest-296704052 None] 75347da8-ac14-4d65-832d-b26ff7464045 was raw, no need to convert to raw {{(pid=80839) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}}
Nov 19 13:00:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-38ac8500-2f63-4c5f-992b-7c91506ca39a tempest-TestStampPattern-1012733486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:01:02 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=35,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=1 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:01:03 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=32,cinder:INSERT=6,cinder:UPDATE=22,cinder:DELETE=1 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:01:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1e9a9dec-e7a8-43ca-9ece-45c446b8758d tempest-VolumesActionsTest-296704052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 16.864s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:01:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1e9a9dec-e7a8-43ca-9ece-45c446b8758d tempest-VolumesActionsTest-296704052 None] Uploaded volume to glance image-id: 75347da8-ac14-4d65-832d-b26ff7464045. {{(pid=80839) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 19 13:01:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-38ac8500-2f63-4c5f-992b-7c91506ca39a tempest-TestStampPattern-1012733486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.970s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:01:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-38ac8500-2f63-4c5f-992b-7c91506ca39a tempest-TestStampPattern-1012733486 None] Creating offline snapshot 0d8217e4-d885-4851-a535-1b27279cb01f of volume 036399b6-86ab-420a-acc9-beb79c566c89 {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 13:01:04 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-1e9a9dec-e7a8-43ca-9ece-45c446b8758d tempest-VolumesActionsTest-296704052 None] Copy volume to image completed successfully.
Nov 19 13:01:04 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ba424a-e264-4ff6-aa2e-099d4742105e]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:01:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-38ac8500-2f63-4c5f-992b-7c91506ca39a tempest-TestStampPattern-1012733486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 13:01:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:01:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:01:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:01:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:01:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:01:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:04 devstack sudo[91498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:01:04 devstack sudo[91498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:04 devstack sudo[91497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89
Nov 19 13:01:04 devstack sudo[91497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:05 devstack sudo[91498]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.578s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:05 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:01:05 devstack sudo[91497]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-38ac8500-2f63-4c5f-992b-7c91506ca39a tempest-TestStampPattern-1012733486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89" returned: 0 in 0.765s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-38ac8500-2f63-4c5f-992b-7c91506ca39a tempest-TestStampPattern-1012733486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.0d8217e4-d885-4851-a535-1b27279cb01f 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:05 devstack sudo[91505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.0d8217e4-d885-4851-a535-1b27279cb01f 1G
Nov 19 13:01:05 devstack sudo[91505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7c2f228b-ee31-4866-8e1d-c7e20ad46f71 tempest-VolumesActionsTest-296704052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:01:05 devstack sudo[91505]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-38ac8500-2f63-4c5f-992b-7c91506ca39a tempest-TestStampPattern-1012733486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.0d8217e4-d885-4851-a535-1b27279cb01f 1G" returned: 0 in 0.687s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-38ac8500-2f63-4c5f-992b-7c91506ca39a tempest-TestStampPattern-1012733486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-036399b6-86ab-420a-acc9-beb79c566c89 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.0d8217e4-d885-4851-a535-1b27279cb01f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:05 devstack sudo[91523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-036399b6-86ab-420a-acc9-beb79c566c89 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.0d8217e4-d885-4851-a535-1b27279cb01f
Nov 19 13:01:05 devstack sudo[91523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:06 devstack sudo[91523]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-38ac8500-2f63-4c5f-992b-7c91506ca39a tempest-TestStampPattern-1012733486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-036399b6-86ab-420a-acc9-beb79c566c89 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.0d8217e4-d885-4851-a535-1b27279cb01f" returned: 0 in 0.502s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:06 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-38ac8500-2f63-4c5f-992b-7c91506ca39a tempest-TestStampPattern-1012733486 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.0d8217e4-d885-4851-a535-1b27279cb01f is being set with open permissions: ugo+rw
Nov 19 13:01:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-38ac8500-2f63-4c5f-992b-7c91506ca39a tempest-TestStampPattern-1012733486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.0d8217e4-d885-4851-a535-1b27279cb01f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:06 devstack sudo[91531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.0d8217e4-d885-4851-a535-1b27279cb01f
Nov 19 13:01:06 devstack sudo[91531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:06 devstack sudo[91531]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-38ac8500-2f63-4c5f-992b-7c91506ca39a tempest-TestStampPattern-1012733486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.0d8217e4-d885-4851-a535-1b27279cb01f" returned: 0 in 0.525s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-38ac8500-2f63-4c5f-992b-7c91506ca39a tempest-TestStampPattern-1012733486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:06 devstack sudo[91535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.info
Nov 19 13:01:06 devstack sudo[91535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:07 devstack sudo[91535]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-38ac8500-2f63-4c5f-992b-7c91506ca39a tempest-TestStampPattern-1012733486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.info" returned: 0 in 0.525s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:07 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-38ac8500-2f63-4c5f-992b-7c91506ca39a tempest-TestStampPattern-1012733486 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.info is being set with open permissions: ugo+rw
Nov 19 13:01:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-38ac8500-2f63-4c5f-992b-7c91506ca39a tempest-TestStampPattern-1012733486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:07 devstack sudo[91538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.info
Nov 19 13:01:07 devstack sudo[91538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:07 devstack sudo[91538]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-38ac8500-2f63-4c5f-992b-7c91506ca39a tempest-TestStampPattern-1012733486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.info" returned: 0 in 0.466s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-38ac8500-2f63-4c5f-992b-7c91506ca39a tempest-TestStampPattern-1012733486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.525s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:01:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7c2f228b-ee31-4866-8e1d-c7e20ad46f71 tempest-VolumesActionsTest-296704052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.127s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:01:07 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[257e03a4-5a17-4ea9-b3f5-4db25465f40d]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:01:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7c2f228b-ee31-4866-8e1d-c7e20ad46f71 tempest-VolumesActionsTest-296704052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:07 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-38ac8500-2f63-4c5f-992b-7c91506ca39a tempest-TestStampPattern-1012733486 None] Create snapshot completed successfully
Nov 19 13:01:07 devstack sudo[91542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5
Nov 19 13:01:07 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:08 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7c2f228b-ee31-4866-8e1d-c7e20ad46f71 tempest-VolumesActionsTest-296704052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5" returned: 0 in 0.584s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:08 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b148cc1-74e6-4067-b894-1e1e8d52c477]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:01:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7c2f228b-ee31-4866-8e1d-c7e20ad46f71 tempest-VolumesActionsTest-296704052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:08 devstack sudo[91554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5
Nov 19 13:01:08 devstack sudo[91554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:09 devstack sudo[91554]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7c2f228b-ee31-4866-8e1d-c7e20ad46f71 tempest-VolumesActionsTest-296704052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5" returned: 0 in 0.601s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7c2f228b-ee31-4866-8e1d-c7e20ad46f71 tempest-VolumesActionsTest-296704052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5 /opt/stack/data/cinder/conversion/7ceada1e-c27b-4d11-a027-3483416d39c5.temp_image.b9285fa2-25af-499f-a010-32ab4f7f74dfo0958r0p.img {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:09 devstack sudo[91570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5 /opt/stack/data/cinder/conversion/7ceada1e-c27b-4d11-a027-3483416d39c5.temp_image.b9285fa2-25af-499f-a010-32ab4f7f74dfo0958r0p.img
Nov 19 13:01:09 devstack sudo[91570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:12 devstack sudo[91570]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7c2f228b-ee31-4866-8e1d-c7e20ad46f71 tempest-VolumesActionsTest-296704052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5 /opt/stack/data/cinder/conversion/7ceada1e-c27b-4d11-a027-3483416d39c5.temp_image.b9285fa2-25af-499f-a010-32ab4f7f74dfo0958r0p.img" returned: 0 in 3.177s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:12 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[25db9e75-2137-462a-8fa7-8d326bbf0eab]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:01:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7c2f228b-ee31-4866-8e1d-c7e20ad46f71 tempest-VolumesActionsTest-296704052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:12 devstack sudo[91649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5
Nov 19 13:01:12 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:14 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7c2f228b-ee31-4866-8e1d-c7e20ad46f71 tempest-VolumesActionsTest-296704052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5" returned: 0 in 1.861s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:14 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-7c2f228b-ee31-4866-8e1d-c7e20ad46f71 tempest-VolumesActionsTest-296704052 None] Image conversion details: src /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5, size 1024.00 MB, duration 3.18 sec, destination /opt/stack/data/cinder/conversion/7ceada1e-c27b-4d11-a027-3483416d39c5.temp_image.b9285fa2-25af-499f-a010-32ab4f7f74dfo0958r0p.img {{(pid=80839) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 19 13:01:14 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-7c2f228b-ee31-4866-8e1d-c7e20ad46f71 tempest-VolumesActionsTest-296704052 None] Converted 1024.00 MB image at 322.19 MB/s
Nov 19 13:01:14 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-7c2f228b-ee31-4866-8e1d-c7e20ad46f71 tempest-VolumesActionsTest-296704052 None] b9285fa2-25af-499f-a010-32ab4f7f74df was raw, converting to qcow2 {{(pid=80839) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}}
Nov 19 13:01:14 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[901aafa8-ff8c-4999-bdf0-0ad9c074a129]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:01:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7c2f228b-ee31-4866-8e1d-c7e20ad46f71 tempest-VolumesActionsTest-296704052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7ceada1e-c27b-4d11-a027-3483416d39c5.temp_image.b9285fa2-25af-499f-a010-32ab4f7f74dfo0958r0p.img {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:14 devstack sudo[91746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7ceada1e-c27b-4d11-a027-3483416d39c5.temp_image.b9285fa2-25af-499f-a010-32ab4f7f74dfo0958r0p.img
Nov 19 13:01:14 devstack sudo[91746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:15 devstack sudo[91746]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7c2f228b-ee31-4866-8e1d-c7e20ad46f71 tempest-VolumesActionsTest-296704052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7ceada1e-c27b-4d11-a027-3483416d39c5.temp_image.b9285fa2-25af-499f-a010-32ab4f7f74dfo0958r0p.img" returned: 0 in 0.893s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7c2f228b-ee31-4866-8e1d-c7e20ad46f71 tempest-VolumesActionsTest-296704052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7ceada1e-c27b-4d11-a027-3483416d39c5.temp_image.b9285fa2-25af-499f-a010-32ab4f7f74dfo0958r0p.img {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:15 devstack sudo[91757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7ceada1e-c27b-4d11-a027-3483416d39c5.temp_image.b9285fa2-25af-499f-a010-32ab4f7f74dfo0958r0p.img
Nov 19 13:01:15 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:15 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7c2f228b-ee31-4866-8e1d-c7e20ad46f71 tempest-VolumesActionsTest-296704052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7ceada1e-c27b-4d11-a027-3483416d39c5.temp_image.b9285fa2-25af-499f-a010-32ab4f7f74dfo0958r0p.img" returned: 1 in 0.816s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7c2f228b-ee31-4866-8e1d-c7e20ad46f71 tempest-VolumesActionsTest-296704052 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7ceada1e-c27b-4d11-a027-3483416d39c5.temp_image.b9285fa2-25af-499f-a010-32ab4f7f74dfo0958r0p.img' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 13:01:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7c2f228b-ee31-4866-8e1d-c7e20ad46f71 tempest-VolumesActionsTest-296704052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7ceada1e-c27b-4d11-a027-3483416d39c5.temp_image.b9285fa2-25af-499f-a010-32ab4f7f74dfo0958r0p.img /opt/stack/data/cinder/conversion/vol_upload_f5079wls {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:15 devstack sudo[91763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7ceada1e-c27b-4d11-a027-3483416d39c5.temp_image.b9285fa2-25af-499f-a010-32ab4f7f74dfo0958r0p.img /opt/stack/data/cinder/conversion/vol_upload_f5079wls
Nov 19 13:01:15 devstack sudo[91763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:16 devstack sudo[91763]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7c2f228b-ee31-4866-8e1d-c7e20ad46f71 tempest-VolumesActionsTest-296704052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7ceada1e-c27b-4d11-a027-3483416d39c5.temp_image.b9285fa2-25af-499f-a010-32ab4f7f74dfo0958r0p.img /opt/stack/data/cinder/conversion/vol_upload_f5079wls" returned: 0 in 0.779s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:16 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-7c2f228b-ee31-4866-8e1d-c7e20ad46f71 tempest-VolumesActionsTest-296704052 None] Image conversion details: src /opt/stack/data/cinder/conversion/7ceada1e-c27b-4d11-a027-3483416d39c5.temp_image.b9285fa2-25af-499f-a010-32ab4f7f74dfo0958r0p.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_f5079wls {{(pid=80839) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 19 13:01:16 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-7c2f228b-ee31-4866-8e1d-c7e20ad46f71 tempest-VolumesActionsTest-296704052 None] Converted 1024.00 MB image at 1024.00 MB/s
Nov 19 13:01:16 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[284b526b-7127-43a1-bcf2-7c10762e8f4e]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:01:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7c2f228b-ee31-4866-8e1d-c7e20ad46f71 tempest-VolumesActionsTest-296704052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_f5079wls {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:16 devstack sudo[91771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_f5079wls
Nov 19 13:01:16 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:17 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7c2f228b-ee31-4866-8e1d-c7e20ad46f71 tempest-VolumesActionsTest-296704052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_f5079wls" returned: 0 in 0.637s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7c2f228b-ee31-4866-8e1d-c7e20ad46f71 tempest-VolumesActionsTest-296704052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.599s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7c2f228b-ee31-4866-8e1d-c7e20ad46f71 tempest-VolumesActionsTest-296704052 None] Uploaded volume to glance image-id: b9285fa2-25af-499f-a010-32ab4f7f74df. {{(pid=80839) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 19 13:01:18 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-7c2f228b-ee31-4866-8e1d-c7e20ad46f71 tempest-VolumesActionsTest-296704052 None] Copy volume to image completed successfully.
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Flow 'volume_create_manager' (ae746b73-6b8a-4e3b-8599-8c7d06438351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2088ef9-3acc-464d-a7d8-bce3ff751635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2088ef9-3acc-464d-a7d8-bce3ff751635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-265639984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce116d3f-8b95-407b-b8e3-9d9b30ae4037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f550a6352ba4c25a2854cc1bc2f63ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0d8217e4-d885-4851-a535-1b27279cb01f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:01:19Z,use_quota=True,user_id='536527624e9348f1b1409ecfaef68ca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de27fea-9311-4a53-a0d1-a07feabf3e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de27fea-9311-4a53-a0d1-a07feabf3e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed871cd8-b320-49aa-8352-d0453db7587a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed871cd8-b320-49aa-8352-d0453db7587a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ce116d3f-8b95-407b-b8e3-9d9b30ae4037', 'volume_name': 'volume-ce116d3f-8b95-407b-b8e3-9d9b30ae4037', 'volume_size': 1, 'snapshot_id': '0d8217e4-d885-4851-a535-1b27279cb01f'}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01a2212-2a78-45e5-adc5-1f093101107e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01a2212-2a78-45e5-adc5-1f093101107e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3fbee03-3341-4e81-b2f5-b73b24a3219e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:01:18 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Volume ce116d3f-8b95-407b-b8e3-9d9b30ae4037: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ce116d3f-8b95-407b-b8e3-9d9b30ae4037', 'volume_size': 1, 'snapshot_id': '0d8217e4-d885-4851-a535-1b27279cb01f'}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Acquiring lock "cinder-quobyte-0d8217e4-d885-4851-a535-1b27279cb01f-ce116d3f-8b95-407b-b8e3-9d9b30ae4037" by "_create_volume_from_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Lock "cinder-quobyte-0d8217e4-d885-4851-a535-1b27279cb01f-ce116d3f-8b95-407b-b8e3-9d9b30ae4037" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Creating volume ce116d3f-8b95-407b-b8e3-9d9b30ae4037 from snapshot 0d8217e4-d885-4851-a535-1b27279cb01f {{(pid=80839) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Acquiring lock "cinder-quobyte-ce116d3f-8b95-407b-b8e3-9d9b30ae4037" by "_copy_volume_from_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Lock "cinder-quobyte-ce116d3f-8b95-407b-b8e3-9d9b30ae4037" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] snapshot: 0d8217e4-d885-4851-a535-1b27279cb01f, volume: ce116d3f-8b95-407b-b8e3-9d9b30ae4037,  {{(pid=80839) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:392}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[babc510f-a860-47f3-8692-a9c3364290fb]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:01:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.0d8217e4-d885-4851-a535-1b27279cb01f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:18 devstack sudo[91776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.0d8217e4-d885-4851-a535-1b27279cb01f
Nov 19 13:01:18 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:19 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.0d8217e4-d885-4851-a535-1b27279cb01f" returned: 0 in 0.630s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:19 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-036399b6-86ab-420a-acc9-beb79c566c89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:01:19 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89 {{(pid=80839) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:411}}
Nov 19 13:01:19 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Creating direct copy from snapshot {{(pid=80839) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:419}}
Nov 19 13:01:19 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d79d6b-a8a5-4043-addc-323ca56982fc]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:01:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:19 devstack sudo[91781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89
Nov 19 13:01:19 devstack sudo[91781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:20 devstack sudo[91781]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89" returned: 0 in 0.765s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:20 devstack cinder-volume[80839]: DEBUG cinder.utils [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Path /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ce116d3f-8b95-407b-b8e3-9d9b30ae4037 not found in is_blk_device check {{(pid=80839) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Nov 19 13:01:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ce116d3f-8b95-407b-b8e3-9d9b30ae4037 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:20 devstack sudo[91788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ce116d3f-8b95-407b-b8e3-9d9b30ae4037
Nov 19 13:01:20 devstack sudo[91788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6fb0281f-359d-4c6f-a1e4-c43e449452d9 tempest-VolumesActionsTest-296704052 None] Acquiring lock "cinder-7ceada1e-c27b-4d11-a027-3483416d39c5-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:01:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6fb0281f-359d-4c6f-a1e4-c43e449452d9 tempest-VolumesActionsTest-296704052 None] Lock "cinder-7ceada1e-c27b-4d11-a027-3483416d39c5-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:01:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6fb0281f-359d-4c6f-a1e4-c43e449452d9 tempest-VolumesActionsTest-296704052 None] Acquiring lock "cinder-quobyte-7ceada1e-c27b-4d11-a027-3483416d39c5" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:01:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6fb0281f-359d-4c6f-a1e4-c43e449452d9 tempest-VolumesActionsTest-296704052 None] Lock "cinder-quobyte-7ceada1e-c27b-4d11-a027-3483416d39c5" acquired by "delete_volume" :: waited 0.023s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:01:20 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ad9c52-79bb-402f-8f79-a4b3bf4cc3a0]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:01:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6fb0281f-359d-4c6f-a1e4-c43e449452d9 tempest-VolumesActionsTest-296704052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:20 devstack sudo[91790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5
Nov 19 13:01:20 devstack sudo[91790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:22 devstack sudo[91790]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6fb0281f-359d-4c6f-a1e4-c43e449452d9 tempest-VolumesActionsTest-296704052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5" returned: 0 in 1.415s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6fb0281f-359d-4c6f-a1e4-c43e449452d9 tempest-VolumesActionsTest-296704052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:22 devstack sudo[91806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5
Nov 19 13:01:22 devstack sudo[91806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:23 devstack sudo[91806]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6fb0281f-359d-4c6f-a1e4-c43e449452d9 tempest-VolumesActionsTest-296704052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7ceada1e-c27b-4d11-a027-3483416d39c5" returned: 0 in 1.570s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6fb0281f-359d-4c6f-a1e4-c43e449452d9 tempest-VolumesActionsTest-296704052 None] Lock "cinder-quobyte-7ceada1e-c27b-4d11-a027-3483416d39c5" released by "delete_volume" :: held 3.032s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:01:23 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-6fb0281f-359d-4c6f-a1e4-c43e449452d9 tempest-VolumesActionsTest-296704052 None] Created reservations ['2e3e9aee-b2d4-4010-a08b-2a117c1a4ba8', 'ff4c2e4b-8f1b-47dd-b30a-8830109d44c6', '9e7c1901-dd8a-4ae1-b639-0c154c770acd', '561b94af-05f7-463d-83aa-16794d03bffe'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:01:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6fb0281f-359d-4c6f-a1e4-c43e449452d9 tempest-VolumesActionsTest-296704052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:01:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6fb0281f-359d-4c6f-a1e4-c43e449452d9 tempest-VolumesActionsTest-296704052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:01:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6fb0281f-359d-4c6f-a1e4-c43e449452d9 tempest-VolumesActionsTest-296704052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:01:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6fb0281f-359d-4c6f-a1e4-c43e449452d9 tempest-VolumesActionsTest-296704052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:01:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6fb0281f-359d-4c6f-a1e4-c43e449452d9 tempest-VolumesActionsTest-296704052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:01:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6fb0281f-359d-4c6f-a1e4-c43e449452d9 tempest-VolumesActionsTest-296704052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:23 devstack sudo[91810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:01:23 devstack sudo[91810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:23 devstack sudo[91788]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ce116d3f-8b95-407b-b8e3-9d9b30ae4037" returned: 0 in 3.531s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:23 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f7e6f3-2e29-4493-961c-406918bb1faa]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:01:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:23 devstack sudo[91812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89
Nov 19 13:01:23 devstack sudo[91812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:24 devstack sudo[91810]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6fb0281f-359d-4c6f-a1e4-c43e449452d9 tempest-VolumesActionsTest-296704052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.510s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:24 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-6fb0281f-359d-4c6f-a1e4-c43e449452d9 tempest-VolumesActionsTest-296704052 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:01:24 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-6fb0281f-359d-4c6f-a1e4-c43e449452d9 tempest-VolumesActionsTest-296704052 None] Deleted volume successfully.
Nov 19 13:01:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6fb0281f-359d-4c6f-a1e4-c43e449452d9 tempest-VolumesActionsTest-296704052 None] Lock "cinder-7ceada1e-c27b-4d11-a027-3483416d39c5-delete_volume" released by "delete_volume" :: held 3.755s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:01:24 devstack sudo[91812]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89" returned: 0 in 0.896s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:24 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Image conversion details: src /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89, size 1024.00 MB, duration 3.53 sec, destination /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ce116d3f-8b95-407b-b8e3-9d9b30ae4037 {{(pid=80839) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 19 13:01:24 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Converted 1024.00 MB image at 289.85 MB/s
Nov 19 13:01:24 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ce116d3f-8b95-407b-b8e3-9d9b30ae4037 is being set with open permissions: ugo+rw
Nov 19 13:01:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ce116d3f-8b95-407b-b8e3-9d9b30ae4037 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:24 devstack sudo[91818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ce116d3f-8b95-407b-b8e3-9d9b30ae4037
Nov 19 13:01:24 devstack sudo[91818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:25 devstack sudo[91818]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ce116d3f-8b95-407b-b8e3-9d9b30ae4037" returned: 0 in 0.961s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Lock "cinder-quobyte-ce116d3f-8b95-407b-b8e3-9d9b30ae4037" released by "_copy_volume_from_snapshot" :: held 6.958s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:01:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Lock "cinder-quobyte-0d8217e4-d885-4851-a535-1b27279cb01f-ce116d3f-8b95-407b-b8e3-9d9b30ae4037" released by "_create_volume_from_snapshot" :: held 6.986s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:01:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.995s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:01:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3fbee03-3341-4e81-b2f5-b73b24a3219e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce116d3f-8b95-407b-b8e3-9d9b30ae4037', 'volume_size': 1, 'snapshot_id': '0d8217e4-d885-4851-a535-1b27279cb01f'}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:01:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ec8c9d-c1c1-432e-a3ed-1671a063aff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:01:25 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Volume volume-ce116d3f-8b95-407b-b8e3-9d9b30ae4037 (ce116d3f-8b95-407b-b8e3-9d9b30ae4037): created successfully
Nov 19 13:01:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ec8c9d-c1c1-432e-a3ed-1671a063aff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:01:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Flow 'volume_create_manager' (ae746b73-6b8a-4e3b-8599-8c7d06438351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:01:25 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-d37769ab-0e35-48c0-b403-858efd398af7 tempest-TestStampPattern-1012733486 None] Created volume successfully.
Nov 19 13:01:30 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:01:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Flow 'volume_create_manager' (124331e7-89aa-4ee6-b9e0-0bfd47510ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:01:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d60c425-7b60-4c6a-84f7-7e42b6314153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:01:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d60c425-7b60-4c6a-84f7-7e42b6314153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1862728649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b95e721-39a2-4211-9b6c-b7a6605b3c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5199c3d44b944e69e34d8ec01a4efe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:01:30Z,use_quota=True,user_id='e0ce61d961ed4c42ba3a4c04911abd33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:01:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e6214e-6d77-457d-8009-661e92b7226a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:01:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e6214e-6d77-457d-8009-661e92b7226a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:01:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e70258b-5d4b-49ec-93d2-ed6ed3749f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:01:30 devstack cinder-volume[80839]: DEBUG cinder.image.glance [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Creating Keystone auth plugin from conf {{(pid=80839) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Nov 19 13:01:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e70258b-5d4b-49ec-93d2-ed6ed3749f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4b95e721-39a2-4211-9b6c-b7a6605b3c1b', 'volume_name': 'volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b', 'volume_size': 1, 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb13a00dd9444268988d63a8279e0575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5d491c17-c417-4a2b-886e-ad2958917626', 'created_at': datetime.datetime(2025, 11, 19, 11, 46, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 19, 11, 46, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d491c17-c417-4a2b-886e-ad2958917626/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbd13ab26b0>}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:01:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42355a3-427e-427f-89b5-7f6dc1c72f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:01:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42355a3-427e-427f-89b5-7f6dc1c72f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:01:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b5fb61-ae14-4fc0-ae82-b0c3ad9a9b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:01:30 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Volume 4b95e721-39a2-4211-9b6c-b7a6605b3c1b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b', 'volume_size': 1, 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb13a00dd9444268988d63a8279e0575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5d491c17-c417-4a2b-886e-ad2958917626', 'created_at': datetime.datetime(2025, 11, 19, 11, 46, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 19, 11, 46, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d491c17-c417-4a2b-886e-ad2958917626/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbd13ab26b0>}
Nov 19 13:01:30 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Cloning 4b95e721-39a2-4211-9b6c-b7a6605b3c1b from image 5d491c17-c417-4a2b-886e-ad2958917626  at location (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]). {{(pid=80839) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Nov 19 13:01:30 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_vmpy2l27devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=80839) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Nov 19 13:01:30 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Image download 20.69 MB at 20.69 MB/s
Nov 19 13:01:30 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9b191a-6cdc-4992-81e8-6583090c744b]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:01:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_vmpy2l27devstack@QuobyteHD {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:30 devstack sudo[91848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_vmpy2l27devstack@QuobyteHD
Nov 19 13:01:30 devstack sudo[91848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:31 devstack sudo[91848]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_vmpy2l27devstack@QuobyteHD" returned: 0 in 0.612s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:31 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Temporary image 5d491c17-c417-4a2b-886e-ad2958917626 is fetched for user e0ce61d961ed4c42ba3a4c04911abd33. {{(pid=80839) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Nov 19 13:01:31 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea81e37d-6018-4715-a67e-6df5f28bf34f]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:01:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_vmpy2l27devstack@QuobyteHD {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:31 devstack sudo[91853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_vmpy2l27devstack@QuobyteHD
Nov 19 13:01:31 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:31 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_vmpy2l27devstack@QuobyteHD" returned: 0 in 0.670s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:01:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:01:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1862728649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b95e721-39a2-4211-9b6c-b7a6605b3c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5199c3d44b944e69e34d8ec01a4efe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:01:30Z,use_quota=True,user_id='e0ce61d961ed4c42ba3a4c04911abd33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:01:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Creating volume 4b95e721-39a2-4211-9b6c-b7a6605b3c1b {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:01:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:01:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:01:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:01:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:01:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:01:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:01:31 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:01:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:31 devstack sudo[91874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b 1073741824
Nov 19 13:01:31 devstack sudo[91874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:32 devstack sudo[91874]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b 1073741824" returned: 0 in 0.926s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:32 devstack sudo[91934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b
Nov 19 13:01:32 devstack sudo[91934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:33 devstack sudo[91934]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b" returned: 0 in 0.909s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:33 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:01:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:01:33 devstack cinder-volume[80839]: DEBUG cinder.volume.volume_utils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Attempting download of 5d491c17-c417-4a2b-886e-ad2958917626 ((None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}])) to volume 4b95e721-39a2-4211-9b6c-b7a6605b3c1b. {{(pid=80839) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Nov 19 13:01:33 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ba6d85-18d1-4228-ab61-1f79c52f9b80]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:01:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_hp2jb98h {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:34 devstack sudo[91970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_hp2jb98h
Nov 19 13:01:34 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:34 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_hp2jb98h" returned: 0 in 0.686s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_hp2jb98h {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:34 devstack sudo[91992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_hp2jb98h
Nov 19 13:01:34 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:35 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_hp2jb98h" returned: 1 in 0.648s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_hp2jb98h' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 13:01:35 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7444f1c3-834c-4eb7-9a3b-ee857faa4701]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:01:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_vmpy2l27devstack@QuobyteHD {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:35 devstack sudo[92004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_vmpy2l27devstack@QuobyteHD
Nov 19 13:01:35 devstack sudo[92004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:36 devstack sudo[92004]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_vmpy2l27devstack@QuobyteHD" returned: 0 in 0.773s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:36 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] 5d491c17-c417-4a2b-886e-ad2958917626 was qcow2, converting to raw {{(pid=80839) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Nov 19 13:01:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_vmpy2l27devstack@QuobyteHD /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:36 devstack sudo[92009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_vmpy2l27devstack@QuobyteHD /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b
Nov 19 13:01:36 devstack sudo[92009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:37 devstack sudo[92009]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_vmpy2l27devstack@QuobyteHD /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b" returned: 0 in 1.617s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:37 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_vmpy2l27devstack@QuobyteHD, size 112.00 MB, duration 1.62 sec, destination /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b {{(pid=80839) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 19 13:01:37 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Converted 112.00 MB image at 69.16 MB/s
Nov 19 13:01:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:37 devstack sudo[92019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b 1G
Nov 19 13:01:37 devstack sudo[92019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:38 devstack sudo[92019]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b 1G" returned: 0 in 0.549s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:38 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f966d0d7-7314-453e-ae1f-5f88ca4cf98a]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:01:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:38 devstack sudo[92025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b
Nov 19 13:01:38 devstack sudo[92025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:38 devstack sudo[92025]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b" returned: 0 in 0.673s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:39 devstack sudo[92035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b
Nov 19 13:01:39 devstack sudo[92035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:39 devstack sudo[92035]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b" returned: 1 in 0.573s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 13:01:39 devstack cinder-volume[80839]: DEBUG cinder.volume.volume_utils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Downloaded image 5d491c17-c417-4a2b-886e-ad2958917626 ((None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}])) to volume 4b95e721-39a2-4211-9b6c-b7a6605b3c1b successfully. {{(pid=80839) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Nov 19 13:01:39 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Temporary image 5d491c17-c417-4a2b-886e-ad2958917626 for user e0ce61d961ed4c42ba3a4c04911abd33 is deleted. {{(pid=80839) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Nov 19 13:01:39 devstack cinder-volume[80839]: DEBUG cinder.volume.volume_utils [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Marking volume 4b95e721-39a2-4211-9b6c-b7a6605b3c1b as bootable. {{(pid=80839) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Nov 19 13:01:39 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Copying metadata from image 5d491c17-c417-4a2b-886e-ad2958917626 to 4b95e721-39a2-4211-9b6c-b7a6605b3c1b. {{(pid=80839) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 19 13:01:39 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Creating volume glance metadata for volume 4b95e721-39a2-4211-9b6c-b7a6605b3c1b backed by image 5d491c17-c417-4a2b-886e-ad2958917626 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=80839) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 19 13:01:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b5fb61-ae14-4fc0-ae82-b0c3ad9a9b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b', 'volume_size': 1, 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb13a00dd9444268988d63a8279e0575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5d491c17-c417-4a2b-886e-ad2958917626', 'created_at': datetime.datetime(2025, 11, 19, 11, 46, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 19, 11, 46, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d491c17-c417-4a2b-886e-ad2958917626/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbd13ab26b0>}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:01:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51903b6-f7a2-4e00-a5b7-a0fce8135da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:01:39 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Volume volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b (4b95e721-39a2-4211-9b6c-b7a6605b3c1b): created successfully
Nov 19 13:01:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51903b6-f7a2-4e00-a5b7-a0fce8135da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:01:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Flow 'volume_create_manager' (124331e7-89aa-4ee6-b9e0-0bfd47510ab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:01:39 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-4fc15923-8d82-4444-83f8-45168627bab5 tempest-VolumesExtendTest-16191492 None] Created volume successfully.
Nov 19 13:01:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4d28e20b-ed24-40c6-9fae-72ebafbc3c73 tempest-VolumesExtendTest-16191492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:01:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4d28e20b-ed24-40c6-9fae-72ebafbc3c73 tempest-VolumesExtendTest-16191492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:01:39 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd5e3ee-539d-47dd-a31d-5edc72161d9a]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:01:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4d28e20b-ed24-40c6-9fae-72ebafbc3c73 tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:40 devstack sudo[92040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b
Nov 19 13:01:40 devstack sudo[92040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:40 devstack sudo[92040]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4d28e20b-ed24-40c6-9fae-72ebafbc3c73 tempest-VolumesExtendTest-16191492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b" returned: 0 in 0.638s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4d28e20b-ed24-40c6-9fae-72ebafbc3c73 tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:40 devstack sudo[92045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b
Nov 19 13:01:40 devstack sudo[92045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:41 devstack sudo[92045]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4d28e20b-ed24-40c6-9fae-72ebafbc3c73 tempest-VolumesExtendTest-16191492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b" returned: 1 in 0.657s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4d28e20b-ed24-40c6-9fae-72ebafbc3c73 tempest-VolumesExtendTest-16191492 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 13:01:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4d28e20b-ed24-40c6-9fae-72ebafbc3c73 tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b 2G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4d28e20b-ed24-40c6-9fae-72ebafbc3c73 tempest-VolumesExtendTest-16191492 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b 2G" returned: 0 in 0.057s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4d28e20b-ed24-40c6-9fae-72ebafbc3c73 tempest-VolumesExtendTest-16191492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.411s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:01:41 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-4d28e20b-ed24-40c6-9fae-72ebafbc3c73 tempest-VolumesExtendTest-16191492 None] Extend volume completed successfully.
Nov 19 13:01:42 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-81d25c09-22bb-45ac-98f2-39685367395b tempest-VolumesExtendTest-16191492 None] Acquiring lock "cinder-4b95e721-39a2-4211-9b6c-b7a6605b3c1b-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:01:42 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-81d25c09-22bb-45ac-98f2-39685367395b tempest-VolumesExtendTest-16191492 None] Lock "cinder-4b95e721-39a2-4211-9b6c-b7a6605b3c1b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:01:42 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-81d25c09-22bb-45ac-98f2-39685367395b tempest-VolumesExtendTest-16191492 None] Acquiring lock "cinder-quobyte-4b95e721-39a2-4211-9b6c-b7a6605b3c1b" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:01:42 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-81d25c09-22bb-45ac-98f2-39685367395b tempest-VolumesExtendTest-16191492 None] Lock "cinder-quobyte-4b95e721-39a2-4211-9b6c-b7a6605b3c1b" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:01:42 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7c1a7d-5464-4168-8a81-4542c62a2514]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:01:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-81d25c09-22bb-45ac-98f2-39685367395b tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:42 devstack sudo[92053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b
Nov 19 13:01:42 devstack sudo[92053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:42 devstack sudo[92053]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-81d25c09-22bb-45ac-98f2-39685367395b tempest-VolumesExtendTest-16191492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b" returned: 0 in 0.573s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-81d25c09-22bb-45ac-98f2-39685367395b tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:42 devstack sudo[92058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b
Nov 19 13:01:42 devstack sudo[92058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:43 devstack sudo[92058]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-81d25c09-22bb-45ac-98f2-39685367395b tempest-VolumesExtendTest-16191492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b" returned: 1 in 0.582s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-81d25c09-22bb-45ac-98f2-39685367395b tempest-VolumesExtendTest-16191492 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 13:01:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-81d25c09-22bb-45ac-98f2-39685367395b tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:43 devstack sudo[92063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b
Nov 19 13:01:43 devstack sudo[92063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:43 devstack sudo[92063]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-81d25c09-22bb-45ac-98f2-39685367395b tempest-VolumesExtendTest-16191492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4b95e721-39a2-4211-9b6c-b7a6605b3c1b" returned: 0 in 0.445s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:43 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-81d25c09-22bb-45ac-98f2-39685367395b tempest-VolumesExtendTest-16191492 None] Lock "cinder-quobyte-4b95e721-39a2-4211-9b6c-b7a6605b3c1b" released by "delete_volume" :: held 1.658s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:01:43 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-81d25c09-22bb-45ac-98f2-39685367395b tempest-VolumesExtendTest-16191492 None] Created reservations ['675c07ac-19c3-4fc3-ab68-90453ca41b7c', '5554c90b-e32a-4bc9-b2e2-d38c590d61a4', '739fdafb-605e-4e97-a07c-8e232cdaeae8', 'c9d6620d-349a-4726-88ba-636a8127aa4b'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:01:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-81d25c09-22bb-45ac-98f2-39685367395b tempest-VolumesExtendTest-16191492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:01:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-81d25c09-22bb-45ac-98f2-39685367395b tempest-VolumesExtendTest-16191492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:01:43 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-81d25c09-22bb-45ac-98f2-39685367395b tempest-VolumesExtendTest-16191492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:01:43 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-81d25c09-22bb-45ac-98f2-39685367395b tempest-VolumesExtendTest-16191492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:01:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-81d25c09-22bb-45ac-98f2-39685367395b tempest-VolumesExtendTest-16191492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:01:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-81d25c09-22bb-45ac-98f2-39685367395b tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:44 devstack sudo[92066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:01:44 devstack sudo[92066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:44 devstack sudo[92066]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-81d25c09-22bb-45ac-98f2-39685367395b tempest-VolumesExtendTest-16191492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.479s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:44 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-81d25c09-22bb-45ac-98f2-39685367395b tempest-VolumesExtendTest-16191492 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:01:44 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-81d25c09-22bb-45ac-98f2-39685367395b tempest-VolumesExtendTest-16191492 None] Deleted volume successfully.
Nov 19 13:01:44 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-81d25c09-22bb-45ac-98f2-39685367395b tempest-VolumesExtendTest-16191492 None] Lock "cinder-4b95e721-39a2-4211-9b6c-b7a6605b3c1b-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:01:44 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:01:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Flow 'volume_create_manager' (e2da38d6-08e6-4543-a848-ccc636c32eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:01:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e515191-296f-4396-a6ee-81f3e58f14e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:01:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e515191-296f-4396-a6ee-81f3e58f14e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-693791977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b090cbf-9b31-4cc0-91e0-ef8bf66e224e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5199c3d44b944e69e34d8ec01a4efe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:01:45Z,use_quota=True,user_id='e0ce61d961ed4c42ba3a4c04911abd33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:01:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ada222-b538-4326-9562-054d895b5098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:01:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ada222-b538-4326-9562-054d895b5098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:01:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdaf3a36-64d0-4af4-a5f0-4896bd97eebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:01:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdaf3a36-64d0-4af4-a5f0-4896bd97eebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b090cbf-9b31-4cc0-91e0-ef8bf66e224e', 'volume_name': 'volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:01:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f6c66c-0f96-40f0-a833-ad533161e5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:01:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f6c66c-0f96-40f0-a833-ad533161e5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:01:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0b354c-5be7-45b5-8785-f01ce88e05e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:01:44 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Volume 7b090cbf-9b31-4cc0-91e0-ef8bf66e224e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e', 'volume_size': 1}
Nov 19 13:01:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:01:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:01:44 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-693791977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b090cbf-9b31-4cc0-91e0-ef8bf66e224e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5199c3d44b944e69e34d8ec01a4efe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:01:45Z,use_quota=True,user_id='e0ce61d961ed4c42ba3a4c04911abd33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:01:44 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Creating volume 7b090cbf-9b31-4cc0-91e0-ef8bf66e224e {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:01:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:01:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:01:44 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:01:44 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:01:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:01:44 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:01:44 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:01:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:44 devstack sudo[92069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e 1073741824
Nov 19 13:01:44 devstack sudo[92069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:45 devstack sudo[92069]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e 1073741824" returned: 0 in 0.599s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:45 devstack sudo[92074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e
Nov 19 13:01:45 devstack sudo[92074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:45 devstack sudo[92074]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e" returned: 0 in 0.465s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:45 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:01:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:01:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0b354c-5be7-45b5-8785-f01ce88e05e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:01:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bafff8e1-8d80-4f74-a400-c61320170f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:01:45 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Volume volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e (7b090cbf-9b31-4cc0-91e0-ef8bf66e224e): created successfully
Nov 19 13:01:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bafff8e1-8d80-4f74-a400-c61320170f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:01:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Flow 'volume_create_manager' (e2da38d6-08e6-4543-a848-ccc636c32eee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:01:45 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-318a697f-a526-4cc9-b610-9e23b0822e12 tempest-VolumesExtendTest-16191492 None] Created volume successfully.
Nov 19 13:01:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7bccf78d-884e-416b-8f6f-89b9f5df11d6 tempest-VolumesExtendTest-16191492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:01:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7bccf78d-884e-416b-8f6f-89b9f5df11d6 tempest-VolumesExtendTest-16191492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:01:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-7bccf78d-884e-416b-8f6f-89b9f5df11d6 tempest-VolumesExtendTest-16191492 None] Creating offline snapshot a3c1be2f-8cbf-4636-9e05-ea2e1a11c324 of volume 7b090cbf-9b31-4cc0-91e0-ef8bf66e224e {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 13:01:47 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4849b2a3-3f78-4841-a4c6-79d78a5be6dc]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:01:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7bccf78d-884e-416b-8f6f-89b9f5df11d6 tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:47 devstack sudo[92077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e
Nov 19 13:01:47 devstack sudo[92077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:47 devstack sudo[92077]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7bccf78d-884e-416b-8f6f-89b9f5df11d6 tempest-VolumesExtendTest-16191492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e" returned: 0 in 0.578s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7bccf78d-884e-416b-8f6f-89b9f5df11d6 tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.a3c1be2f-8cbf-4636-9e05-ea2e1a11c324 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:47 devstack sudo[92082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.a3c1be2f-8cbf-4636-9e05-ea2e1a11c324 1G
Nov 19 13:01:47 devstack sudo[92082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:48 devstack sudo[92082]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7bccf78d-884e-416b-8f6f-89b9f5df11d6 tempest-VolumesExtendTest-16191492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.a3c1be2f-8cbf-4636-9e05-ea2e1a11c324 1G" returned: 0 in 0.554s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7bccf78d-884e-416b-8f6f-89b9f5df11d6 tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.a3c1be2f-8cbf-4636-9e05-ea2e1a11c324 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:48 devstack sudo[92087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.a3c1be2f-8cbf-4636-9e05-ea2e1a11c324
Nov 19 13:01:48 devstack sudo[92087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:48 devstack sudo[92087]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7bccf78d-884e-416b-8f6f-89b9f5df11d6 tempest-VolumesExtendTest-16191492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.a3c1be2f-8cbf-4636-9e05-ea2e1a11c324" returned: 0 in 0.507s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:48 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-7bccf78d-884e-416b-8f6f-89b9f5df11d6 tempest-VolumesExtendTest-16191492 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.a3c1be2f-8cbf-4636-9e05-ea2e1a11c324 is being set with open permissions: ugo+rw
Nov 19 13:01:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7bccf78d-884e-416b-8f6f-89b9f5df11d6 tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.a3c1be2f-8cbf-4636-9e05-ea2e1a11c324 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:48 devstack sudo[92092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.a3c1be2f-8cbf-4636-9e05-ea2e1a11c324
Nov 19 13:01:48 devstack sudo[92092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:49 devstack sudo[92092]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7bccf78d-884e-416b-8f6f-89b9f5df11d6 tempest-VolumesExtendTest-16191492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.a3c1be2f-8cbf-4636-9e05-ea2e1a11c324" returned: 0 in 0.448s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7bccf78d-884e-416b-8f6f-89b9f5df11d6 tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:49 devstack sudo[92097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.info
Nov 19 13:01:49 devstack sudo[92097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:49 devstack sudo[92097]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7bccf78d-884e-416b-8f6f-89b9f5df11d6 tempest-VolumesExtendTest-16191492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.info" returned: 0 in 0.458s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:49 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-7bccf78d-884e-416b-8f6f-89b9f5df11d6 tempest-VolumesExtendTest-16191492 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.info is being set with open permissions: ugo+rw
Nov 19 13:01:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7bccf78d-884e-416b-8f6f-89b9f5df11d6 tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:49 devstack sudo[92100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.info
Nov 19 13:01:49 devstack sudo[92100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:50 devstack sudo[92100]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7bccf78d-884e-416b-8f6f-89b9f5df11d6 tempest-VolumesExtendTest-16191492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.info" returned: 0 in 0.447s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7bccf78d-884e-416b-8f6f-89b9f5df11d6 tempest-VolumesExtendTest-16191492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.038s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:01:50 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-7bccf78d-884e-416b-8f6f-89b9f5df11d6 tempest-VolumesExtendTest-16191492 None] Create snapshot completed successfully
Nov 19 13:01:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0830459b-b267-40f6-b504-b86b43d1dd7c tempest-VolumesExtendTest-16191492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:01:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0830459b-b267-40f6-b504-b86b43d1dd7c tempest-VolumesExtendTest-16191492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:01:51 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd80ca2-12de-4666-b04a-cfb141a71100]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:01:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0830459b-b267-40f6-b504-b86b43d1dd7c tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:51 devstack sudo[92103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e
Nov 19 13:01:51 devstack sudo[92103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:51 devstack sudo[92103]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0830459b-b267-40f6-b504-b86b43d1dd7c tempest-VolumesExtendTest-16191492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e" returned: 0 in 0.565s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0830459b-b267-40f6-b504-b86b43d1dd7c tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.a3c1be2f-8cbf-4636-9e05-ea2e1a11c324 2G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0830459b-b267-40f6-b504-b86b43d1dd7c tempest-VolumesExtendTest-16191492 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.a3c1be2f-8cbf-4636-9e05-ea2e1a11c324 2G" returned: 0 in 0.102s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0830459b-b267-40f6-b504-b86b43d1dd7c tempest-VolumesExtendTest-16191492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.690s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:01:51 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-0830459b-b267-40f6-b504-b86b43d1dd7c tempest-VolumesExtendTest-16191492 None] Extend volume completed successfully.
Nov 19 13:01:52 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b68cc3e8-0141-41d7-9a5f-619ca310c7da tempest-VolumesExtendTest-16191492 None] Acquiring lock "cinder-a3c1be2f-8cbf-4636-9e05-ea2e1a11c324-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:01:52 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b68cc3e8-0141-41d7-9a5f-619ca310c7da tempest-VolumesExtendTest-16191492 None] Lock "cinder-a3c1be2f-8cbf-4636-9e05-ea2e1a11c324-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:01:52 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b68cc3e8-0141-41d7-9a5f-619ca310c7da tempest-VolumesExtendTest-16191492 None] Acquiring lock "cinder-quobyte-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:01:52 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b68cc3e8-0141-41d7-9a5f-619ca310c7da tempest-VolumesExtendTest-16191492 None] Lock "cinder-quobyte-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e" acquired by "delete_snapshot" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:01:52 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b68cc3e8-0141-41d7-9a5f-619ca310c7da tempest-VolumesExtendTest-16191492 None] Acquiring lock "cinder-quobyte-a3c1be2f-8cbf-4636-9e05-ea2e1a11c324" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:01:52 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b68cc3e8-0141-41d7-9a5f-619ca310c7da tempest-VolumesExtendTest-16191492 None] Lock "cinder-quobyte-a3c1be2f-8cbf-4636-9e05-ea2e1a11c324" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:01:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-b68cc3e8-0141-41d7-9a5f-619ca310c7da tempest-VolumesExtendTest-16191492 None] Deleting offline snapshot a3c1be2f-8cbf-4636-9e05-ea2e1a11c324 of volume 7b090cbf-9b31-4cc0-91e0-ef8bf66e224e {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 13:01:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-b68cc3e8-0141-41d7-9a5f-619ca310c7da tempest-VolumesExtendTest-16191492 None] snapshot_file for this snap is: volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.a3c1be2f-8cbf-4636-9e05-ea2e1a11c324 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 13:01:52 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c8dbf7-2d96-4fa3-b5d1-3f9a0703d16f]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:01:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b68cc3e8-0141-41d7-9a5f-619ca310c7da tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.a3c1be2f-8cbf-4636-9e05-ea2e1a11c324 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:52 devstack sudo[92113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.a3c1be2f-8cbf-4636-9e05-ea2e1a11c324
Nov 19 13:01:52 devstack sudo[92113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:53 devstack sudo[92113]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b68cc3e8-0141-41d7-9a5f-619ca310c7da tempest-VolumesExtendTest-16191492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.a3c1be2f-8cbf-4636-9e05-ea2e1a11c324" returned: 0 in 0.580s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:53 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-b68cc3e8-0141-41d7-9a5f-619ca310c7da tempest-VolumesExtendTest-16191492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:01:53 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b8c5c7-1b4b-46a6-aa0d-179209699da3]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:01:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b68cc3e8-0141-41d7-9a5f-619ca310c7da tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:53 devstack sudo[92125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e
Nov 19 13:01:53 devstack sudo[92125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:53 devstack sudo[92125]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b68cc3e8-0141-41d7-9a5f-619ca310c7da tempest-VolumesExtendTest-16191492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e" returned: 0 in 0.563s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b68cc3e8-0141-41d7-9a5f-619ca310c7da tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.a3c1be2f-8cbf-4636-9e05-ea2e1a11c324 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:53 devstack sudo[92132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.a3c1be2f-8cbf-4636-9e05-ea2e1a11c324
Nov 19 13:01:53 devstack sudo[92132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:54 devstack sudo[92132]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b68cc3e8-0141-41d7-9a5f-619ca310c7da tempest-VolumesExtendTest-16191492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.a3c1be2f-8cbf-4636-9e05-ea2e1a11c324" returned: 0 in 0.511s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b68cc3e8-0141-41d7-9a5f-619ca310c7da tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.a3c1be2f-8cbf-4636-9e05-ea2e1a11c324 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:54 devstack sudo[92139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.a3c1be2f-8cbf-4636-9e05-ea2e1a11c324
Nov 19 13:01:54 devstack sudo[92139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:54 devstack sudo[92139]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b68cc3e8-0141-41d7-9a5f-619ca310c7da tempest-VolumesExtendTest-16191492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e.a3c1be2f-8cbf-4636-9e05-ea2e1a11c324" returned: 0 in 0.466s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:54 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b68cc3e8-0141-41d7-9a5f-619ca310c7da tempest-VolumesExtendTest-16191492 None] Lock "cinder-quobyte-a3c1be2f-8cbf-4636-9e05-ea2e1a11c324" released by "_delete_snapshot" :: held 2.188s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:01:54 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b68cc3e8-0141-41d7-9a5f-619ca310c7da tempest-VolumesExtendTest-16191492 None] Lock "cinder-quobyte-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e" released by "delete_snapshot" :: held 2.201s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:01:54 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-b68cc3e8-0141-41d7-9a5f-619ca310c7da tempest-VolumesExtendTest-16191492 None] Created reservations ['54d0b285-452b-4d13-a675-5d4871b68f04', '9b28ae2c-4172-43c1-a23b-db1a7b0f4cff', 'a7c6fe04-9d88-45df-b0a0-04df46d5c7dd', 'c88026a4-c391-4d81-98cb-fa7a7399896c'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:01:54 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-b68cc3e8-0141-41d7-9a5f-619ca310c7da tempest-VolumesExtendTest-16191492 None] Delete snapshot completed successfully.
Nov 19 13:01:54 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b68cc3e8-0141-41d7-9a5f-619ca310c7da tempest-VolumesExtendTest-16191492 None] Lock "cinder-a3c1be2f-8cbf-4636-9e05-ea2e1a11c324-delete_snapshot" released by "delete_snapshot" :: held 2.283s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:01:55 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5ab69239-95ea-4979-875c-e15a6b5cd9ed tempest-VolumesExtendTest-16191492 None] Acquiring lock "cinder-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:01:55 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5ab69239-95ea-4979-875c-e15a6b5cd9ed tempest-VolumesExtendTest-16191492 None] Lock "cinder-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:01:55 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5ab69239-95ea-4979-875c-e15a6b5cd9ed tempest-VolumesExtendTest-16191492 None] Acquiring lock "cinder-quobyte-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:01:55 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5ab69239-95ea-4979-875c-e15a6b5cd9ed tempest-VolumesExtendTest-16191492 None] Lock "cinder-quobyte-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e" acquired by "delete_volume" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:01:55 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd815c8-d174-46db-a3b5-2c94c6a49b07]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:01:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5ab69239-95ea-4979-875c-e15a6b5cd9ed tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:55 devstack sudo[92163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e
Nov 19 13:01:55 devstack sudo[92163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:56 devstack sudo[92163]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5ab69239-95ea-4979-875c-e15a6b5cd9ed tempest-VolumesExtendTest-16191492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e" returned: 0 in 0.568s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5ab69239-95ea-4979-875c-e15a6b5cd9ed tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:56 devstack sudo[92168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e
Nov 19 13:01:56 devstack sudo[92168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:56 devstack sudo[92168]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5ab69239-95ea-4979-875c-e15a6b5cd9ed tempest-VolumesExtendTest-16191492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e" returned: 0 in 0.446s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:56 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5ab69239-95ea-4979-875c-e15a6b5cd9ed tempest-VolumesExtendTest-16191492 None] Lock "cinder-quobyte-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e" released by "delete_volume" :: held 1.052s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:01:56 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-5ab69239-95ea-4979-875c-e15a6b5cd9ed tempest-VolumesExtendTest-16191492 None] Created reservations ['2bc6bf76-9366-43fb-927a-5117d56c8731', '65aff07d-071f-4ab2-9270-5ba6a078a679', 'aa8550c1-c6d2-418c-893d-128d39a72847', '99ce4036-d43d-49a0-aefa-e93633736ab5'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:01:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5ab69239-95ea-4979-875c-e15a6b5cd9ed tempest-VolumesExtendTest-16191492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:01:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5ab69239-95ea-4979-875c-e15a6b5cd9ed tempest-VolumesExtendTest-16191492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:01:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5ab69239-95ea-4979-875c-e15a6b5cd9ed tempest-VolumesExtendTest-16191492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:01:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5ab69239-95ea-4979-875c-e15a6b5cd9ed tempest-VolumesExtendTest-16191492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:01:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5ab69239-95ea-4979-875c-e15a6b5cd9ed tempest-VolumesExtendTest-16191492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:01:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5ab69239-95ea-4979-875c-e15a6b5cd9ed tempest-VolumesExtendTest-16191492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:56 devstack sudo[92171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:01:56 devstack sudo[92171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:01:57 devstack sudo[92171]: pam_unix(sudo:session): session closed for user root
Nov 19 13:01:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5ab69239-95ea-4979-875c-e15a6b5cd9ed tempest-VolumesExtendTest-16191492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.445s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:01:57 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-5ab69239-95ea-4979-875c-e15a6b5cd9ed tempest-VolumesExtendTest-16191492 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:01:57 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-5ab69239-95ea-4979-875c-e15a6b5cd9ed tempest-VolumesExtendTest-16191492 None] Deleted volume successfully.
Nov 19 13:01:57 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5ab69239-95ea-4979-875c-e15a6b5cd9ed tempest-VolumesExtendTest-16191492 None] Lock "cinder-7b090cbf-9b31-4cc0-91e0-ef8bf66e224e-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:01:59 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:01:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Flow 'volume_create_manager' (6623fb05-1899-44b6-9c75-97fca879bf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:01:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc8e443-5cd6-4e0b-923d-8f84c5122a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:01:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc8e443-5cd6-4e0b-923d-8f84c5122a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-858602121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f268d03-4720-4880-b3cb-d6284f4e62ad,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bebcb25264704218a3fcbe0cee808f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:02:00Z,use_quota=True,user_id='56a9024b8a6d42a6894d7b4b7e762127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:01:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (655c244a-7945-41aa-ae45-171d3f91c1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:01:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (655c244a-7945-41aa-ae45-171d3f91c1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:01:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3747d810-9fc2-4a20-bcdf-7f4572cb4148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:01:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3747d810-9fc2-4a20-bcdf-7f4572cb4148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f268d03-4720-4880-b3cb-d6284f4e62ad', 'volume_name': 'volume-3f268d03-4720-4880-b3cb-d6284f4e62ad', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:01:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b12102-4990-4ac7-b054-ff1905a68fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:01:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b12102-4990-4ac7-b054-ff1905a68fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:01:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70894b8-e179-4095-892d-473e2d4e5c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:01:59 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Volume 3f268d03-4720-4880-b3cb-d6284f4e62ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f268d03-4720-4880-b3cb-d6284f4e62ad', 'volume_size': 1}
Nov 19 13:01:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:01:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:01:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-858602121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f268d03-4720-4880-b3cb-d6284f4e62ad,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bebcb25264704218a3fcbe0cee808f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:02:00Z,use_quota=True,user_id='56a9024b8a6d42a6894d7b4b7e762127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:01:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Creating volume 3f268d03-4720-4880-b3cb-d6284f4e62ad {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:01:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:01:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:01:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:01:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:01:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:01:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:01:59 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:01:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3f268d03-4720-4880-b3cb-d6284f4e62ad 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:01:59 devstack sudo[92179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3f268d03-4720-4880-b3cb-d6284f4e62ad 1073741824
Nov 19 13:01:59 devstack sudo[92179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:00 devstack sudo[92179]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3f268d03-4720-4880-b3cb-d6284f4e62ad 1073741824" returned: 0 in 0.569s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3f268d03-4720-4880-b3cb-d6284f4e62ad {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:00 devstack sudo[92186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3f268d03-4720-4880-b3cb-d6284f4e62ad
Nov 19 13:02:00 devstack sudo[92186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:00 devstack sudo[92186]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3f268d03-4720-4880-b3cb-d6284f4e62ad" returned: 0 in 0.535s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:00 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:02:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:02:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70894b8-e179-4095-892d-473e2d4e5c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f268d03-4720-4880-b3cb-d6284f4e62ad', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6719f983-4c05-47ed-aa40-62e23249613d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:00 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Volume volume-3f268d03-4720-4880-b3cb-d6284f4e62ad (3f268d03-4720-4880-b3cb-d6284f4e62ad): created successfully
Nov 19 13:02:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6719f983-4c05-47ed-aa40-62e23249613d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Flow 'volume_create_manager' (6623fb05-1899-44b6-9c75-97fca879bf8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:02:00 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-98aa3ad1-7816-4ff5-9dc6-1048746bfb95 tempest-VolumesListTestJSON-1706782187 None] Created volume successfully.
Nov 19 13:02:02 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:02:02 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Flow 'volume_create_manager' (bb6d038d-61b1-4133-9522-a7b38aec77f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:02:02 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d256a193-2ee1-4657-8b91-7e798b72c61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:02 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d256a193-2ee1-4657-8b91-7e798b72c61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-995720280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2324190-c77e-48a6-ba14-02abaa8ad261,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bebcb25264704218a3fcbe0cee808f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:02:02Z,use_quota=True,user_id='56a9024b8a6d42a6894d7b4b7e762127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:02 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46bb1d06-e8cd-4371-8662-6e1e22118bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:02 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46bb1d06-e8cd-4371-8662-6e1e22118bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:02 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b18ea0d9-506a-4e2a-8d4f-69aae489044b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:02 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b18ea0d9-506a-4e2a-8d4f-69aae489044b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2324190-c77e-48a6-ba14-02abaa8ad261', 'volume_name': 'volume-e2324190-c77e-48a6-ba14-02abaa8ad261', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:02 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8993f035-6ab6-4d16-b2d7-3f87595a7f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:02 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8993f035-6ab6-4d16-b2d7-3f87595a7f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:02 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85d108a-1e19-4c8a-b76c-50d03b0d3627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:02 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Volume e2324190-c77e-48a6-ba14-02abaa8ad261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2324190-c77e-48a6-ba14-02abaa8ad261', 'volume_size': 1}
Nov 19 13:02:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:02:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:02:02 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-995720280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2324190-c77e-48a6-ba14-02abaa8ad261,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bebcb25264704218a3fcbe0cee808f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:02:02Z,use_quota=True,user_id='56a9024b8a6d42a6894d7b4b7e762127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:02:02 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Creating volume e2324190-c77e-48a6-ba14-02abaa8ad261 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:02:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:02:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:02:02 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:02:02 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:02:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:02:02 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:02:02 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:02:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e2324190-c77e-48a6-ba14-02abaa8ad261 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:02 devstack sudo[92198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e2324190-c77e-48a6-ba14-02abaa8ad261 1073741824
Nov 19 13:02:02 devstack sudo[92198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:02 devstack sudo[92198]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e2324190-c77e-48a6-ba14-02abaa8ad261 1073741824" returned: 0 in 0.568s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e2324190-c77e-48a6-ba14-02abaa8ad261 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:02 devstack sudo[92204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e2324190-c77e-48a6-ba14-02abaa8ad261
Nov 19 13:02:02 devstack sudo[92204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:03 devstack sudo[92204]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e2324190-c77e-48a6-ba14-02abaa8ad261" returned: 0 in 0.445s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:03 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:02:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:02:03 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=40,cinder:DELETE=6,cinder:UPDATE=43,cinder:INSERT=17 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:02:03 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85d108a-1e19-4c8a-b76c-50d03b0d3627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2324190-c77e-48a6-ba14-02abaa8ad261', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:03 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda49571-3f1e-459a-9993-7ba33dcbb048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:03 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Volume volume-e2324190-c77e-48a6-ba14-02abaa8ad261 (e2324190-c77e-48a6-ba14-02abaa8ad261): created successfully
Nov 19 13:02:03 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda49571-3f1e-459a-9993-7ba33dcbb048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:03 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Flow 'volume_create_manager' (bb6d038d-61b1-4133-9522-a7b38aec77f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:02:03 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-d671b6e9-09ea-45ea-90ce-fcddc09dc798 tempest-VolumesListTestJSON-1706782187 None] Created volume successfully.
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:04 devstack sudo[92207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:02:04 devstack sudo[92207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:UPDATE=56,cinder:SELECT=44,cinder:INSERT=12,cinder:DELETE=3 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Flow 'volume_create_manager' (b147c053-c0bf-41e9-8d9d-19280897ae29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3370e07-b878-4c26-9a52-427f428ef9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3370e07-b878-4c26-9a52-427f428ef9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1510921192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59a30557-ec1f-4c68-a2cd-615ef037c78c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bebcb25264704218a3fcbe0cee808f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:02:05Z,use_quota=True,user_id='56a9024b8a6d42a6894d7b4b7e762127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f427993-54ca-4616-8b0a-ca3bacbee13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f427993-54ca-4616-8b0a-ca3bacbee13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c8ebfb-ee98-418c-a24a-2eb8969fb22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c8ebfb-ee98-418c-a24a-2eb8969fb22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59a30557-ec1f-4c68-a2cd-615ef037c78c', 'volume_name': 'volume-59a30557-ec1f-4c68-a2cd-615ef037c78c', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8bf75e-1623-400a-8835-db735d4bdeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8bf75e-1623-400a-8835-db735d4bdeee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1bb662-5d6d-448a-b79b-0b01c531d009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:04 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Volume 59a30557-ec1f-4c68-a2cd-615ef037c78c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59a30557-ec1f-4c68-a2cd-615ef037c78c', 'volume_size': 1}
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1510921192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59a30557-ec1f-4c68-a2cd-615ef037c78c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bebcb25264704218a3fcbe0cee808f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:02:05Z,use_quota=True,user_id='56a9024b8a6d42a6894d7b4b7e762127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Creating volume 59a30557-ec1f-4c68-a2cd-615ef037c78c {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:02:04 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:02:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59a30557-ec1f-4c68-a2cd-615ef037c78c 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:04 devstack sudo[92209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59a30557-ec1f-4c68-a2cd-615ef037c78c 1073741824
Nov 19 13:02:04 devstack sudo[92209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:05 devstack sudo[92207]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.571s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:05 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:02:05 devstack sudo[92209]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59a30557-ec1f-4c68-a2cd-615ef037c78c 1073741824" returned: 0 in 0.572s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59a30557-ec1f-4c68-a2cd-615ef037c78c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:05 devstack sudo[92215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59a30557-ec1f-4c68-a2cd-615ef037c78c
Nov 19 13:02:05 devstack sudo[92215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:05 devstack sudo[92215]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59a30557-ec1f-4c68-a2cd-615ef037c78c" returned: 0 in 0.473s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:05 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:02:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:02:05 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1bb662-5d6d-448a-b79b-0b01c531d009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59a30557-ec1f-4c68-a2cd-615ef037c78c', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:05 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (596f7a06-90a5-4805-8659-f457d9491a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:05 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Volume volume-59a30557-ec1f-4c68-a2cd-615ef037c78c (59a30557-ec1f-4c68-a2cd-615ef037c78c): created successfully
Nov 19 13:02:05 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (596f7a06-90a5-4805-8659-f457d9491a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:05 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Flow 'volume_create_manager' (b147c053-c0bf-41e9-8d9d-19280897ae29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:02:05 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-9a8f02d7-9083-4b5b-a522-ca937381a4e5 tempest-VolumesListTestJSON-1706782187 None] Created volume successfully.
Nov 19 13:02:08 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c21a8e27-477b-4bc8-9ac3-b7a764c3ec92 tempest-VolumesListTestJSON-1706782187 None] Acquiring lock "cinder-59a30557-ec1f-4c68-a2cd-615ef037c78c-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:02:08 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c21a8e27-477b-4bc8-9ac3-b7a764c3ec92 tempest-VolumesListTestJSON-1706782187 None] Lock "cinder-59a30557-ec1f-4c68-a2cd-615ef037c78c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:02:08 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c21a8e27-477b-4bc8-9ac3-b7a764c3ec92 tempest-VolumesListTestJSON-1706782187 None] Acquiring lock "cinder-quobyte-59a30557-ec1f-4c68-a2cd-615ef037c78c" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:02:08 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c21a8e27-477b-4bc8-9ac3-b7a764c3ec92 tempest-VolumesListTestJSON-1706782187 None] Lock "cinder-quobyte-59a30557-ec1f-4c68-a2cd-615ef037c78c" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:02:08 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e839d993-5a0b-4d46-8310-a96ff267a3eb]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:02:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c21a8e27-477b-4bc8-9ac3-b7a764c3ec92 tempest-VolumesListTestJSON-1706782187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59a30557-ec1f-4c68-a2cd-615ef037c78c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:08 devstack sudo[92218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59a30557-ec1f-4c68-a2cd-615ef037c78c
Nov 19 13:02:08 devstack sudo[92218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:09 devstack sudo[92218]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c21a8e27-477b-4bc8-9ac3-b7a764c3ec92 tempest-VolumesListTestJSON-1706782187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59a30557-ec1f-4c68-a2cd-615ef037c78c" returned: 0 in 0.584s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c21a8e27-477b-4bc8-9ac3-b7a764c3ec92 tempest-VolumesListTestJSON-1706782187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59a30557-ec1f-4c68-a2cd-615ef037c78c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:09 devstack sudo[92223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59a30557-ec1f-4c68-a2cd-615ef037c78c
Nov 19 13:02:09 devstack sudo[92223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:09 devstack sudo[92223]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c21a8e27-477b-4bc8-9ac3-b7a764c3ec92 tempest-VolumesListTestJSON-1706782187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59a30557-ec1f-4c68-a2cd-615ef037c78c" returned: 0 in 0.471s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:09 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c21a8e27-477b-4bc8-9ac3-b7a764c3ec92 tempest-VolumesListTestJSON-1706782187 None] Lock "cinder-quobyte-59a30557-ec1f-4c68-a2cd-615ef037c78c" released by "delete_volume" :: held 1.110s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:02:09 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-c21a8e27-477b-4bc8-9ac3-b7a764c3ec92 tempest-VolumesListTestJSON-1706782187 None] Created reservations ['5468741c-e71e-4d95-9648-0dd725fc8659', '046a12c2-ca96-4bac-9118-4e7c606f6831', '6fdac4d0-bea7-4cae-9b0c-922c1a69b0cd', 'd05ff41a-07b5-432d-b5d8-618b17c3df1e'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:02:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c21a8e27-477b-4bc8-9ac3-b7a764c3ec92 tempest-VolumesListTestJSON-1706782187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:02:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c21a8e27-477b-4bc8-9ac3-b7a764c3ec92 tempest-VolumesListTestJSON-1706782187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:02:09 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c21a8e27-477b-4bc8-9ac3-b7a764c3ec92 tempest-VolumesListTestJSON-1706782187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:02:09 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c21a8e27-477b-4bc8-9ac3-b7a764c3ec92 tempest-VolumesListTestJSON-1706782187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:02:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c21a8e27-477b-4bc8-9ac3-b7a764c3ec92 tempest-VolumesListTestJSON-1706782187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:02:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c21a8e27-477b-4bc8-9ac3-b7a764c3ec92 tempest-VolumesListTestJSON-1706782187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:09 devstack sudo[92235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:02:09 devstack sudo[92235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:10 devstack sudo[92235]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c21a8e27-477b-4bc8-9ac3-b7a764c3ec92 tempest-VolumesListTestJSON-1706782187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.450s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:10 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-c21a8e27-477b-4bc8-9ac3-b7a764c3ec92 tempest-VolumesListTestJSON-1706782187 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:02:10 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-c21a8e27-477b-4bc8-9ac3-b7a764c3ec92 tempest-VolumesListTestJSON-1706782187 None] Deleted volume successfully.
Nov 19 13:02:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c21a8e27-477b-4bc8-9ac3-b7a764c3ec92 tempest-VolumesListTestJSON-1706782187 None] Lock "cinder-59a30557-ec1f-4c68-a2cd-615ef037c78c-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:02:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c94e55dd-de23-4884-ae36-aa51640bbcba tempest-VolumesListTestJSON-1706782187 None] Acquiring lock "cinder-e2324190-c77e-48a6-ba14-02abaa8ad261-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:02:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c94e55dd-de23-4884-ae36-aa51640bbcba tempest-VolumesListTestJSON-1706782187 None] Lock "cinder-e2324190-c77e-48a6-ba14-02abaa8ad261-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:02:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c94e55dd-de23-4884-ae36-aa51640bbcba tempest-VolumesListTestJSON-1706782187 None] Acquiring lock "cinder-quobyte-e2324190-c77e-48a6-ba14-02abaa8ad261" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:02:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c94e55dd-de23-4884-ae36-aa51640bbcba tempest-VolumesListTestJSON-1706782187 None] Lock "cinder-quobyte-e2324190-c77e-48a6-ba14-02abaa8ad261" acquired by "delete_volume" :: waited 0.018s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:02:10 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac87c5e-aa9a-4057-b046-6a600d83243f]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:02:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c94e55dd-de23-4884-ae36-aa51640bbcba tempest-VolumesListTestJSON-1706782187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e2324190-c77e-48a6-ba14-02abaa8ad261 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:10 devstack sudo[92238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e2324190-c77e-48a6-ba14-02abaa8ad261
Nov 19 13:02:10 devstack sudo[92238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:11 devstack sudo[92238]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c94e55dd-de23-4884-ae36-aa51640bbcba tempest-VolumesListTestJSON-1706782187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e2324190-c77e-48a6-ba14-02abaa8ad261" returned: 0 in 0.598s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c94e55dd-de23-4884-ae36-aa51640bbcba tempest-VolumesListTestJSON-1706782187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e2324190-c77e-48a6-ba14-02abaa8ad261 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:11 devstack sudo[92243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e2324190-c77e-48a6-ba14-02abaa8ad261
Nov 19 13:02:11 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:11 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c94e55dd-de23-4884-ae36-aa51640bbcba tempest-VolumesListTestJSON-1706782187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e2324190-c77e-48a6-ba14-02abaa8ad261" returned: 0 in 0.462s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:11 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c94e55dd-de23-4884-ae36-aa51640bbcba tempest-VolumesListTestJSON-1706782187 None] Lock "cinder-quobyte-e2324190-c77e-48a6-ba14-02abaa8ad261" released by "delete_volume" :: held 1.089s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:02:11 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-c94e55dd-de23-4884-ae36-aa51640bbcba tempest-VolumesListTestJSON-1706782187 None] Created reservations ['89c3b1f9-7031-44f5-9f5c-36e058cb7e04', '6e7bda85-0535-4a09-9d2d-c601d8a256bf', 'f60f6788-aab3-403c-bf27-987d1c4f28ef', '06b90451-666f-4d3c-964d-3812fe9a6782'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:02:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c94e55dd-de23-4884-ae36-aa51640bbcba tempest-VolumesListTestJSON-1706782187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:02:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c94e55dd-de23-4884-ae36-aa51640bbcba tempest-VolumesListTestJSON-1706782187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:02:11 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c94e55dd-de23-4884-ae36-aa51640bbcba tempest-VolumesListTestJSON-1706782187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:02:11 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c94e55dd-de23-4884-ae36-aa51640bbcba tempest-VolumesListTestJSON-1706782187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:02:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c94e55dd-de23-4884-ae36-aa51640bbcba tempest-VolumesListTestJSON-1706782187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:02:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c94e55dd-de23-4884-ae36-aa51640bbcba tempest-VolumesListTestJSON-1706782187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:11 devstack sudo[92246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:02:11 devstack sudo[92246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:12 devstack sudo[92246]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c94e55dd-de23-4884-ae36-aa51640bbcba tempest-VolumesListTestJSON-1706782187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.441s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:12 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-c94e55dd-de23-4884-ae36-aa51640bbcba tempest-VolumesListTestJSON-1706782187 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:02:12 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-c94e55dd-de23-4884-ae36-aa51640bbcba tempest-VolumesListTestJSON-1706782187 None] Deleted volume successfully.
Nov 19 13:02:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c94e55dd-de23-4884-ae36-aa51640bbcba tempest-VolumesListTestJSON-1706782187 None] Lock "cinder-e2324190-c77e-48a6-ba14-02abaa8ad261-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:02:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0ff096f7-8abd-4c06-bbad-ddd15cfbaead tempest-VolumesListTestJSON-1706782187 None] Acquiring lock "cinder-3f268d03-4720-4880-b3cb-d6284f4e62ad-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:02:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0ff096f7-8abd-4c06-bbad-ddd15cfbaead tempest-VolumesListTestJSON-1706782187 None] Lock "cinder-3f268d03-4720-4880-b3cb-d6284f4e62ad-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:02:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0ff096f7-8abd-4c06-bbad-ddd15cfbaead tempest-VolumesListTestJSON-1706782187 None] Acquiring lock "cinder-quobyte-3f268d03-4720-4880-b3cb-d6284f4e62ad" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:02:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0ff096f7-8abd-4c06-bbad-ddd15cfbaead tempest-VolumesListTestJSON-1706782187 None] Lock "cinder-quobyte-3f268d03-4720-4880-b3cb-d6284f4e62ad" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:02:12 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2997fe33-803a-446a-a0a0-5869ea4418b6]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:02:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0ff096f7-8abd-4c06-bbad-ddd15cfbaead tempest-VolumesListTestJSON-1706782187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3f268d03-4720-4880-b3cb-d6284f4e62ad {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:12 devstack sudo[92250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3f268d03-4720-4880-b3cb-d6284f4e62ad
Nov 19 13:02:12 devstack sudo[92250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:13 devstack sudo[92250]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0ff096f7-8abd-4c06-bbad-ddd15cfbaead tempest-VolumesListTestJSON-1706782187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3f268d03-4720-4880-b3cb-d6284f4e62ad" returned: 0 in 0.542s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0ff096f7-8abd-4c06-bbad-ddd15cfbaead tempest-VolumesListTestJSON-1706782187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3f268d03-4720-4880-b3cb-d6284f4e62ad {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:13 devstack sudo[92255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3f268d03-4720-4880-b3cb-d6284f4e62ad
Nov 19 13:02:13 devstack sudo[92255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:13 devstack sudo[92255]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0ff096f7-8abd-4c06-bbad-ddd15cfbaead tempest-VolumesListTestJSON-1706782187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3f268d03-4720-4880-b3cb-d6284f4e62ad" returned: 0 in 0.434s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:13 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0ff096f7-8abd-4c06-bbad-ddd15cfbaead tempest-VolumesListTestJSON-1706782187 None] Lock "cinder-quobyte-3f268d03-4720-4880-b3cb-d6284f4e62ad" released by "delete_volume" :: held 1.003s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:02:13 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-0ff096f7-8abd-4c06-bbad-ddd15cfbaead tempest-VolumesListTestJSON-1706782187 None] Created reservations ['c03251f9-f8b9-46bb-8521-8962bd44af94', 'a72ef02c-de18-4c72-8cd6-bdc746f763b3', 'b029d55b-4943-4ed0-86c7-01d87bd741d9', 'ce71d982-30dd-4629-95b6-fa2b86ce5741'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:02:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0ff096f7-8abd-4c06-bbad-ddd15cfbaead tempest-VolumesListTestJSON-1706782187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:02:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0ff096f7-8abd-4c06-bbad-ddd15cfbaead tempest-VolumesListTestJSON-1706782187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:02:13 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0ff096f7-8abd-4c06-bbad-ddd15cfbaead tempest-VolumesListTestJSON-1706782187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:02:13 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0ff096f7-8abd-4c06-bbad-ddd15cfbaead tempest-VolumesListTestJSON-1706782187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:02:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0ff096f7-8abd-4c06-bbad-ddd15cfbaead tempest-VolumesListTestJSON-1706782187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:02:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0ff096f7-8abd-4c06-bbad-ddd15cfbaead tempest-VolumesListTestJSON-1706782187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:13 devstack sudo[92258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:02:13 devstack sudo[92258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:14 devstack sudo[92258]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0ff096f7-8abd-4c06-bbad-ddd15cfbaead tempest-VolumesListTestJSON-1706782187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.439s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:14 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-0ff096f7-8abd-4c06-bbad-ddd15cfbaead tempest-VolumesListTestJSON-1706782187 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:02:14 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-0ff096f7-8abd-4c06-bbad-ddd15cfbaead tempest-VolumesListTestJSON-1706782187 None] Deleted volume successfully.
Nov 19 13:02:14 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0ff096f7-8abd-4c06-bbad-ddd15cfbaead tempest-VolumesListTestJSON-1706782187 None] Lock "cinder-3f268d03-4720-4880-b3cb-d6284f4e62ad-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:02:16 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:02:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Flow 'volume_create_manager' (5856a8d2-142c-4046-b9b9-930521c55ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:02:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f46ae1f3-0291-4f6e-bce2-4c09fa9cabb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f46ae1f3-0291-4f6e-bce2-4c09fa9cabb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1343507008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4874871-e873-4206-93e6-6fc4820c624b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641dcc2e5e1c457bb15984f68c1ef34c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:02:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:02:17Z,use_quota=True,user_id='35132f22bf8848499d4194c3292a9716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3fd92a9-1096-4f00-a192-55e262f747b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3fd92a9-1096-4f00-a192-55e262f747b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21dd0647-bd6a-4415-919a-0f50d4928855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21dd0647-bd6a-4415-919a-0f50d4928855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4874871-e873-4206-93e6-6fc4820c624b', 'volume_name': 'volume-a4874871-e873-4206-93e6-6fc4820c624b', 'volume_size': 2}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2936853e-001d-4356-900c-34d6ff114e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2936853e-001d-4356-900c-34d6ff114e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (957071fe-dc98-47e3-8408-bd4b050f9faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:17 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Volume a4874871-e873-4206-93e6-6fc4820c624b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4874871-e873-4206-93e6-6fc4820c624b', 'volume_size': 2}
Nov 19 13:02:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:02:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:02:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1343507008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4874871-e873-4206-93e6-6fc4820c624b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641dcc2e5e1c457bb15984f68c1ef34c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:02:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:02:17Z,use_quota=True,user_id='35132f22bf8848499d4194c3292a9716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:02:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Creating volume a4874871-e873-4206-93e6-6fc4820c624b {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:02:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:02:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:02:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:02:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:02:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:02:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:02:17 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:02:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b 2147483648 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:17 devstack sudo[92267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b 2147483648
Nov 19 13:02:17 devstack sudo[92267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:17 devstack sudo[92267]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b 2147483648" returned: 0 in 0.621s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:17 devstack sudo[92273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b
Nov 19 13:02:17 devstack sudo[92273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:18 devstack sudo[92273]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b" returned: 0 in 0.465s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:02:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:02:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (957071fe-dc98-47e3-8408-bd4b050f9faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4874871-e873-4206-93e6-6fc4820c624b', 'volume_size': 2}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db60bc46-aaf7-4f2a-a97a-f2a53806ec35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:18 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Volume volume-a4874871-e873-4206-93e6-6fc4820c624b (a4874871-e873-4206-93e6-6fc4820c624b): created successfully
Nov 19 13:02:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db60bc46-aaf7-4f2a-a97a-f2a53806ec35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Flow 'volume_create_manager' (5856a8d2-142c-4046-b9b9-930521c55ffc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:02:18 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-31078d78-9f68-4d0d-bb04-c3ce9b4c8b00 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Created volume successfully.
Nov 19 13:02:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f7fbd382-8401-4c35-9df7-67f80f7b36e5 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:02:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f7fbd382-8401-4c35-9df7-67f80f7b36e5 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:02:19 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-f7fbd382-8401-4c35-9df7-67f80f7b36e5 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Creating offline snapshot db4d17a7-71be-43d0-bc9c-d62f07b97038 of volume a4874871-e873-4206-93e6-6fc4820c624b {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 13:02:19 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:02:19 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Flow 'volume_create_manager' (08a48550-4ac5-417b-8388-6a859f122e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:02:19 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53dafec1-8eca-4302-9de6-fa18b4431ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:19 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4509ca-e589-4c19-a5ac-d5b00d7a2211]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:02:19 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53dafec1-8eca-4302-9de6-fa18b4431ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-769050782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b35bd912eb5347d7b0afaad572df9393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:02:19Z,use_quota=True,user_id='ebf046c3607e467fbb39418bc52f77f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:19 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af51aa17-1a86-4930-a674-fe0297860b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:19 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af51aa17-1a86-4930-a674-fe0297860b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:19 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed2829f5-2ed8-494f-af82-232d3043fb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:19 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed2829f5-2ed8-494f-af82-232d3043fb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37', 'volume_name': 'volume-eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:19 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2cf59d3-c75b-4639-9906-bf76905a2267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:19 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2cf59d3-c75b-4639-9906-bf76905a2267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:19 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720c80a7-20aa-451b-b190-3b180a102efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:19 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Volume eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37', 'volume_size': 1}
Nov 19 13:02:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:02:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f7fbd382-8401-4c35-9df7-67f80f7b36e5 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:19 devstack sudo[92287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b
Nov 19 13:02:19 devstack sudo[92287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:20 devstack sudo[92287]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f7fbd382-8401-4c35-9df7-67f80f7b36e5 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b" returned: 0 in 0.573s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f7fbd382-8401-4c35-9df7-67f80f7b36e5 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b.db4d17a7-71be-43d0-bc9c-d62f07b97038 2G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:20 devstack sudo[92295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b.db4d17a7-71be-43d0-bc9c-d62f07b97038 2G
Nov 19 13:02:20 devstack sudo[92295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:20 devstack sudo[92295]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f7fbd382-8401-4c35-9df7-67f80f7b36e5 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b.db4d17a7-71be-43d0-bc9c-d62f07b97038 2G" returned: 0 in 0.571s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f7fbd382-8401-4c35-9df7-67f80f7b36e5 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4874871-e873-4206-93e6-6fc4820c624b -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b.db4d17a7-71be-43d0-bc9c-d62f07b97038 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:20 devstack sudo[92305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4874871-e873-4206-93e6-6fc4820c624b -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b.db4d17a7-71be-43d0-bc9c-d62f07b97038
Nov 19 13:02:20 devstack sudo[92305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:21 devstack sudo[92305]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f7fbd382-8401-4c35-9df7-67f80f7b36e5 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4874871-e873-4206-93e6-6fc4820c624b -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b.db4d17a7-71be-43d0-bc9c-d62f07b97038" returned: 0 in 0.480s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:21 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-f7fbd382-8401-4c35-9df7-67f80f7b36e5 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b.db4d17a7-71be-43d0-bc9c-d62f07b97038 is being set with open permissions: ugo+rw
Nov 19 13:02:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f7fbd382-8401-4c35-9df7-67f80f7b36e5 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b.db4d17a7-71be-43d0-bc9c-d62f07b97038 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:21 devstack sudo[92325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b.db4d17a7-71be-43d0-bc9c-d62f07b97038
Nov 19 13:02:21 devstack sudo[92325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:21 devstack sudo[92325]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f7fbd382-8401-4c35-9df7-67f80f7b36e5 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b.db4d17a7-71be-43d0-bc9c-d62f07b97038" returned: 0 in 0.475s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f7fbd382-8401-4c35-9df7-67f80f7b36e5 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:21 devstack sudo[92328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b.info
Nov 19 13:02:21 devstack sudo[92328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:21 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:02:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Flow 'volume_create_manager' (805b1eb7-a05a-4a08-a329-7fee98970ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:02:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05beceb3-0d38-4830-85c7-d282d3b97520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05beceb3-0d38-4830-85c7-d282d3b97520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1131185735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3c1914-a204-4d6b-91ae-916ee2c1584b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f66e688b5a1943268746a692cfe6ed6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:02:22Z,use_quota=True,user_id='a405d1fac9fe4e69a937522feddc6388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ebe351-b8e5-43f6-94e2-691bcdc68403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ebe351-b8e5-43f6-94e2-691bcdc68403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed64851d-3933-4a73-9825-ec3fd7c9011f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed64851d-3933-4a73-9825-ec3fd7c9011f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee3c1914-a204-4d6b-91ae-916ee2c1584b', 'volume_name': 'volume-ee3c1914-a204-4d6b-91ae-916ee2c1584b', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a2273c-8155-4df6-a641-25d33479ee84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a2273c-8155-4df6-a641-25d33479ee84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da8fc39b-617a-430e-85ef-efd7dcfe1aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:21 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Volume ee3c1914-a204-4d6b-91ae-916ee2c1584b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee3c1914-a204-4d6b-91ae-916ee2c1584b', 'volume_size': 1}
Nov 19 13:02:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:02:22 devstack sudo[92328]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f7fbd382-8401-4c35-9df7-67f80f7b36e5 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b.info" returned: 0 in 0.539s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:22 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-f7fbd382-8401-4c35-9df7-67f80f7b36e5 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b.info is being set with open permissions: ugo+rw
Nov 19 13:02:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f7fbd382-8401-4c35-9df7-67f80f7b36e5 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:22 devstack sudo[92331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b.info
Nov 19 13:02:22 devstack sudo[92331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:22 devstack sudo[92331]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f7fbd382-8401-4c35-9df7-67f80f7b36e5 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b.info" returned: 0 in 0.460s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f7fbd382-8401-4c35-9df7-67f80f7b36e5 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.235s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:02:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.129s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:02:22 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-769050782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b35bd912eb5347d7b0afaad572df9393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:02:19Z,use_quota=True,user_id='ebf046c3607e467fbb39418bc52f77f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:02:22 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Creating volume eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:02:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:02:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:02:22 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:02:22 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:02:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:02:22 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:02:22 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:02:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:22 devstack sudo[92334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37 1073741824
Nov 19 13:02:22 devstack sudo[92334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:22 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-f7fbd382-8401-4c35-9df7-67f80f7b36e5 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Create snapshot completed successfully
Nov 19 13:02:23 devstack sudo[92334]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37 1073741824" returned: 0 in 0.533s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:23 devstack sudo[92340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37
Nov 19 13:02:23 devstack sudo[92340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-7bf05a34-5106-4849-ae7f-20810231aa50 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Acquiring lock "cinder-db4d17a7-71be-43d0-bc9c-d62f07b97038-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-7bf05a34-5106-4849-ae7f-20810231aa50 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Lock "cinder-db4d17a7-71be-43d0-bc9c-d62f07b97038-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-7bf05a34-5106-4849-ae7f-20810231aa50 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Acquiring lock "cinder-quobyte-a4874871-e873-4206-93e6-6fc4820c624b" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-7bf05a34-5106-4849-ae7f-20810231aa50 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Lock "cinder-quobyte-a4874871-e873-4206-93e6-6fc4820c624b" acquired by "delete_snapshot" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-7bf05a34-5106-4849-ae7f-20810231aa50 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Acquiring lock "cinder-quobyte-db4d17a7-71be-43d0-bc9c-d62f07b97038" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-7bf05a34-5106-4849-ae7f-20810231aa50 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Lock "cinder-quobyte-db4d17a7-71be-43d0-bc9c-d62f07b97038" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-7bf05a34-5106-4849-ae7f-20810231aa50 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Deleting offline snapshot db4d17a7-71be-43d0-bc9c-d62f07b97038 of volume a4874871-e873-4206-93e6-6fc4820c624b {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 13:02:23 devstack sudo[92340]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-7bf05a34-5106-4849-ae7f-20810231aa50 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] snapshot_file for this snap is: volume-a4874871-e873-4206-93e6-6fc4820c624b.db4d17a7-71be-43d0-bc9c-d62f07b97038 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37" returned: 0 in 0.532s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47ac9f9-7681-4988-b8af-0bef2fb6ee2a]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.729s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1131185735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3c1914-a204-4d6b-91ae-916ee2c1584b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f66e688b5a1943268746a692cfe6ed6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:02:22Z,use_quota=True,user_id='a405d1fac9fe4e69a937522feddc6388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Creating volume ee3c1914-a204-4d6b-91ae-916ee2c1584b {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:02:23 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee3c1914-a204-4d6b-91ae-916ee2c1584b 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7bf05a34-5106-4849-ae7f-20810231aa50 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b.db4d17a7-71be-43d0-bc9c-d62f07b97038 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:23 devstack sudo[92343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee3c1914-a204-4d6b-91ae-916ee2c1584b 1073741824
Nov 19 13:02:23 devstack sudo[92343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720c80a7-20aa-451b-b190-3b180a102efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e173518b-af16-42ed-8fda-a8b3db68a013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:23 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Volume volume-eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37 (eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37): created successfully
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e173518b-af16-42ed-8fda-a8b3db68a013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:23 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Flow 'volume_create_manager' (08a48550-4ac5-417b-8388-6a859f122e08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:02:23 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-5a913963-fa59-439c-8b7a-b444b5b85bb6 tempest-AttachVolumeShelveTestJSON-1725620549 None] Created volume successfully.
Nov 19 13:02:23 devstack sudo[92344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b.db4d17a7-71be-43d0-bc9c-d62f07b97038
Nov 19 13:02:23 devstack sudo[92344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:24 devstack sudo[92343]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee3c1914-a204-4d6b-91ae-916ee2c1584b 1073741824" returned: 0 in 0.655s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee3c1914-a204-4d6b-91ae-916ee2c1584b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:24 devstack sudo[92353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee3c1914-a204-4d6b-91ae-916ee2c1584b
Nov 19 13:02:24 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:24 devstack sudo[92344]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7bf05a34-5106-4849-ae7f-20810231aa50 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b.db4d17a7-71be-43d0-bc9c-d62f07b97038" returned: 0 in 0.736s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:24 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-7bf05a34-5106-4849-ae7f-20810231aa50 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4874871-e873-4206-93e6-6fc4820c624b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:02:24 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d1ffa7-80de-48e4-b1ed-5e94153851e6]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:02:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7bf05a34-5106-4849-ae7f-20810231aa50 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:24 devstack sudo[92355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b
Nov 19 13:02:24 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:24 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee3c1914-a204-4d6b-91ae-916ee2c1584b" returned: 0 in 0.447s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:24 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:02:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:02:24 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da8fc39b-617a-430e-85ef-efd7dcfe1aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee3c1914-a204-4d6b-91ae-916ee2c1584b', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:24 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b57495-f054-4c3b-89f0-b4d05a901625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:02:24 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Volume volume-ee3c1914-a204-4d6b-91ae-916ee2c1584b (ee3c1914-a204-4d6b-91ae-916ee2c1584b): created successfully
Nov 19 13:02:24 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b57495-f054-4c3b-89f0-b4d05a901625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:02:24 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Flow 'volume_create_manager' (805b1eb7-a05a-4a08-a329-7fee98970ca4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:02:24 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-cb0bef22-e9fc-4794-a3ad-55b2ccd468c9 tempest-AttachVolumeTestJSON-1179299540 None] Created volume successfully.
Nov 19 13:02:25 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7bf05a34-5106-4849-ae7f-20810231aa50 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b" returned: 0 in 0.628s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7bf05a34-5106-4849-ae7f-20810231aa50 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b.db4d17a7-71be-43d0-bc9c-d62f07b97038 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:25 devstack sudo[92365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b.db4d17a7-71be-43d0-bc9c-d62f07b97038
Nov 19 13:02:25 devstack sudo[92365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:25 devstack sudo[92365]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7bf05a34-5106-4849-ae7f-20810231aa50 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b.db4d17a7-71be-43d0-bc9c-d62f07b97038" returned: 0 in 0.534s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7bf05a34-5106-4849-ae7f-20810231aa50 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b.db4d17a7-71be-43d0-bc9c-d62f07b97038 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:25 devstack sudo[92370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b.db4d17a7-71be-43d0-bc9c-d62f07b97038
Nov 19 13:02:25 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:26 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7bf05a34-5106-4849-ae7f-20810231aa50 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b.db4d17a7-71be-43d0-bc9c-d62f07b97038" returned: 0 in 0.490s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-7bf05a34-5106-4849-ae7f-20810231aa50 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Lock "cinder-quobyte-db4d17a7-71be-43d0-bc9c-d62f07b97038" released by "_delete_snapshot" :: held 2.483s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:02:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-7bf05a34-5106-4849-ae7f-20810231aa50 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Lock "cinder-quobyte-a4874871-e873-4206-93e6-6fc4820c624b" released by "delete_snapshot" :: held 2.498s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:02:26 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-7bf05a34-5106-4849-ae7f-20810231aa50 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Created reservations ['538e9757-a5b6-4c4d-b413-8219a56bb24c', '2b232a26-8b66-4469-ae01-aebfef9cfa5f', '8ba8e973-b86c-436a-9cb0-db773a612d40', '49299bcd-b30d-45ad-a339-bbfb84c54139'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:02:26 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-7bf05a34-5106-4849-ae7f-20810231aa50 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Delete snapshot completed successfully.
Nov 19 13:02:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-7bf05a34-5106-4849-ae7f-20810231aa50 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Lock "cinder-db4d17a7-71be-43d0-bc9c-d62f07b97038-delete_snapshot" released by "delete_snapshot" :: held 2.587s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:02:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-49c55ea5-453a-474d-b931-bea4300487a6 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Acquiring lock "cinder-a4874871-e873-4206-93e6-6fc4820c624b-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:02:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-49c55ea5-453a-474d-b931-bea4300487a6 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Lock "cinder-a4874871-e873-4206-93e6-6fc4820c624b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:02:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-49c55ea5-453a-474d-b931-bea4300487a6 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Acquiring lock "cinder-quobyte-a4874871-e873-4206-93e6-6fc4820c624b" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:02:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-49c55ea5-453a-474d-b931-bea4300487a6 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Lock "cinder-quobyte-a4874871-e873-4206-93e6-6fc4820c624b" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:02:26 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[424fcd6e-28bb-4e9f-9b68-9903cac2a53c]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:02:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-49c55ea5-453a-474d-b931-bea4300487a6 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:26 devstack sudo[92373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b
Nov 19 13:02:26 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:27 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-49c55ea5-453a-474d-b931-bea4300487a6 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b" returned: 0 in 0.771s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-49c55ea5-453a-474d-b931-bea4300487a6 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:27 devstack sudo[92413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b
Nov 19 13:02:27 devstack sudo[92413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-fc5fc8f6-4ca8-4532-9155-ce07a69ea21b req-43aa5035-3afd-444d-b137-3580038e08ec tempest-AttachVolumeTestJSON-1179299540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:02:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-fc5fc8f6-4ca8-4532-9155-ce07a69ea21b req-43aa5035-3afd-444d-b137-3580038e08ec tempest-AttachVolumeTestJSON-1179299540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:02:28 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[012c51fd-e3a4-46cd-a432-5e0ef551e21e]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:02:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-fc5fc8f6-4ca8-4532-9155-ce07a69ea21b req-43aa5035-3afd-444d-b137-3580038e08ec tempest-AttachVolumeTestJSON-1179299540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee3c1914-a204-4d6b-91ae-916ee2c1584b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:28 devstack sudo[92413]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-49c55ea5-453a-474d-b931-bea4300487a6 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a4874871-e873-4206-93e6-6fc4820c624b" returned: 0 in 0.508s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:28 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-49c55ea5-453a-474d-b931-bea4300487a6 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Lock "cinder-quobyte-a4874871-e873-4206-93e6-6fc4820c624b" released by "delete_volume" :: held 1.356s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:02:28 devstack sudo[92426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee3c1914-a204-4d6b-91ae-916ee2c1584b
Nov 19 13:02:28 devstack sudo[92426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:28 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-49c55ea5-453a-474d-b931-bea4300487a6 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Created reservations ['08434753-fc11-4cf4-b8a8-0255626111f2', 'dd87654a-5979-4976-9ad4-800054305191', 'f0d206cb-c0a0-4d4e-ae6e-251bbab39039', '719405b9-a179-467c-9fd3-f06829cf8b09'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:02:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-49c55ea5-453a-474d-b931-bea4300487a6 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:02:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-49c55ea5-453a-474d-b931-bea4300487a6 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:02:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-49c55ea5-453a-474d-b931-bea4300487a6 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:02:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-49c55ea5-453a-474d-b931-bea4300487a6 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:02:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-49c55ea5-453a-474d-b931-bea4300487a6 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:02:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-49c55ea5-453a-474d-b931-bea4300487a6 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:28 devstack sudo[92428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:02:28 devstack sudo[92428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:28 devstack sudo[92428]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-49c55ea5-453a-474d-b931-bea4300487a6 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.472s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:28 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-49c55ea5-453a-474d-b931-bea4300487a6 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:02:28 devstack sudo[92426]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:28 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-49c55ea5-453a-474d-b931-bea4300487a6 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Deleted volume successfully.
Nov 19 13:02:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-fc5fc8f6-4ca8-4532-9155-ce07a69ea21b req-43aa5035-3afd-444d-b137-3580038e08ec tempest-AttachVolumeTestJSON-1179299540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee3c1914-a204-4d6b-91ae-916ee2c1584b" returned: 0 in 0.713s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-fc5fc8f6-4ca8-4532-9155-ce07a69ea21b req-43aa5035-3afd-444d-b137-3580038e08ec tempest-AttachVolumeTestJSON-1179299540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.744s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:02:28 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-49c55ea5-453a-474d-b931-bea4300487a6 tempest-VolumesSnapshotNegativeTestJSON-756756334 None] Lock "cinder-a4874871-e873-4206-93e6-6fc4820c624b-delete_volume" released by "delete_volume" :: held 1.976s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:02:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-fc5fc8f6-4ca8-4532-9155-ce07a69ea21b req-43aa5035-3afd-444d-b137-3580038e08ec tempest-AttachVolumeTestJSON-1179299540 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-ee3c1914-a204-4d6b-91ae-916ee2c1584b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61f53da7-4afe-454b-8937-570b49bc2be3', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 13:02:28 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-fc5fc8f6-4ca8-4532-9155-ce07a69ea21b req-43aa5035-3afd-444d-b137-3580038e08ec tempest-AttachVolumeTestJSON-1179299540 None] attachment_update completed successfully.
Nov 19 13:02:38 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:UPDATE=31,cinder:SELECT=36,cinder:INSERT=12,cinder:DELETE=3 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:02:38 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:DELETE=7,cinder:SELECT=35,cinder:UPDATE=64,cinder:INSERT=8 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:02:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-a01083b5-e4d6-49cc-90e5-a3d8f9ec8a65 req-ce328cec-0ee0-4595-8f60-05558aa3587b tempest-AttachVolumeShelveTestJSON-1725620549 None] No connector for attachment 098345f1-9eb5-4a83-904e-6dec20e66634; skipping storage backend terminate_connection call. {{(pid=80839) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4978}}
Nov 19 13:02:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-a01083b5-e4d6-49cc-90e5-a3d8f9ec8a65 req-ce328cec-0ee0-4595-8f60-05558aa3587b tempest-AttachVolumeShelveTestJSON-1725620549 None] Deleting attachment 098345f1-9eb5-4a83-904e-6dec20e66634. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 13:02:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-f553ac9c-dc35-4b06-9d62-ea081e1fdfbb req-3238ba2f-87f0-4e2e-be5e-aba60e3b4788 tempest-TestStampPattern-1012733486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:02:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-f553ac9c-dc35-4b06-9d62-ea081e1fdfbb req-3238ba2f-87f0-4e2e-be5e-aba60e3b4788 tempest-TestStampPattern-1012733486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:02:43 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[54244841-8991-4dd6-9d9b-d9d81f3cae5f]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:02:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-f553ac9c-dc35-4b06-9d62-ea081e1fdfbb req-3238ba2f-87f0-4e2e-be5e-aba60e3b4788 tempest-TestStampPattern-1012733486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ce116d3f-8b95-407b-b8e3-9d9b30ae4037 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:02:43 devstack sudo[93055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ce116d3f-8b95-407b-b8e3-9d9b30ae4037
Nov 19 13:02:43 devstack sudo[93055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:02:44 devstack sudo[93055]: pam_unix(sudo:session): session closed for user root
Nov 19 13:02:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-f553ac9c-dc35-4b06-9d62-ea081e1fdfbb req-3238ba2f-87f0-4e2e-be5e-aba60e3b4788 tempest-TestStampPattern-1012733486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ce116d3f-8b95-407b-b8e3-9d9b30ae4037" returned: 0 in 0.681s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:02:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-f553ac9c-dc35-4b06-9d62-ea081e1fdfbb req-3238ba2f-87f0-4e2e-be5e-aba60e3b4788 tempest-TestStampPattern-1012733486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.698s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:02:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-f553ac9c-dc35-4b06-9d62-ea081e1fdfbb req-3238ba2f-87f0-4e2e-be5e-aba60e3b4788 tempest-TestStampPattern-1012733486 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-ce116d3f-8b95-407b-b8e3-9d9b30ae4037', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '652202d5-d3a5-48f3-9a7b-42e924260e35', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 13:02:44 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-f553ac9c-dc35-4b06-9d62-ea081e1fdfbb req-3238ba2f-87f0-4e2e-be5e-aba60e3b4788 tempest-TestStampPattern-1012733486 None] attachment_update completed successfully.
Nov 19 13:02:53 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-23a5221d-017c-433c-896c-172e2b91f5e0 req-71fe7f7f-484c-4dcb-97e4-d65cd8713921 tempest-TestStampPattern-1012733486 None] Terminate volume connection completed successfully.
Nov 19 13:02:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-23a5221d-017c-433c-896c-172e2b91f5e0 req-71fe7f7f-484c-4dcb-97e4-d65cd8713921 tempest-TestStampPattern-1012733486 None] Deleting attachment 652202d5-d3a5-48f3-9a7b-42e924260e35. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 13:03:02 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a256698f-6885-4a7e-a8ac-34a3d373c381 tempest-TestStampPattern-1012733486 None] Acquiring lock "cinder-ce116d3f-8b95-407b-b8e3-9d9b30ae4037-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:03:03 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a256698f-6885-4a7e-a8ac-34a3d373c381 tempest-TestStampPattern-1012733486 None] Lock "cinder-ce116d3f-8b95-407b-b8e3-9d9b30ae4037-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:03:03 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a256698f-6885-4a7e-a8ac-34a3d373c381 tempest-TestStampPattern-1012733486 None] Acquiring lock "cinder-quobyte-ce116d3f-8b95-407b-b8e3-9d9b30ae4037" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:03:03 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a256698f-6885-4a7e-a8ac-34a3d373c381 tempest-TestStampPattern-1012733486 None] Lock "cinder-quobyte-ce116d3f-8b95-407b-b8e3-9d9b30ae4037" acquired by "delete_volume" :: waited 0.019s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:03:03 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[78847011-c649-4a66-9cef-658811059eb6]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:03:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a256698f-6885-4a7e-a8ac-34a3d373c381 tempest-TestStampPattern-1012733486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ce116d3f-8b95-407b-b8e3-9d9b30ae4037 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:03 devstack sudo[93699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ce116d3f-8b95-407b-b8e3-9d9b30ae4037
Nov 19 13:03:03 devstack sudo[93699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:04 devstack sudo[93699]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a256698f-6885-4a7e-a8ac-34a3d373c381 tempest-TestStampPattern-1012733486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ce116d3f-8b95-407b-b8e3-9d9b30ae4037" returned: 0 in 1.124s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a256698f-6885-4a7e-a8ac-34a3d373c381 tempest-TestStampPattern-1012733486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ce116d3f-8b95-407b-b8e3-9d9b30ae4037 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:04 devstack sudo[93742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ce116d3f-8b95-407b-b8e3-9d9b30ae4037
Nov 19 13:03:04 devstack sudo[93742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 13:03:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:03:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:03:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:04 devstack sudo[93744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:03:04 devstack sudo[93744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:04 devstack sudo[93742]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a256698f-6885-4a7e-a8ac-34a3d373c381 tempest-TestStampPattern-1012733486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ce116d3f-8b95-407b-b8e3-9d9b30ae4037" returned: 0 in 0.632s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:04 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a256698f-6885-4a7e-a8ac-34a3d373c381 tempest-TestStampPattern-1012733486 None] Lock "cinder-quobyte-ce116d3f-8b95-407b-b8e3-9d9b30ae4037" released by "delete_volume" :: held 1.895s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:03:05 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-a256698f-6885-4a7e-a8ac-34a3d373c381 tempest-TestStampPattern-1012733486 None] Created reservations ['77e51e69-67eb-4f85-bb74-3592670ed3e2', '82c541ee-31ce-4f35-902e-5e90baf269fe', '0b346f23-80c5-4357-a2f0-7278ca04f79a', 'e0469892-ad43-4c76-aec8-f7672dcac241'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:03:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a256698f-6885-4a7e-a8ac-34a3d373c381 tempest-TestStampPattern-1012733486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a256698f-6885-4a7e-a8ac-34a3d373c381 tempest-TestStampPattern-1012733486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:05 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a256698f-6885-4a7e-a8ac-34a3d373c381 tempest-TestStampPattern-1012733486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:03:05 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a256698f-6885-4a7e-a8ac-34a3d373c381 tempest-TestStampPattern-1012733486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:03:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a256698f-6885-4a7e-a8ac-34a3d373c381 tempest-TestStampPattern-1012733486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a256698f-6885-4a7e-a8ac-34a3d373c381 tempest-TestStampPattern-1012733486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:05 devstack sudo[93747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:03:05 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:05 devstack sudo[93744]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.931s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:05 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:03:05 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-e878fd0e-ccb7-4ba2-b789-3729b68b32c7 tempest-TestStampPattern-1012733486 None] Acquiring lock "cinder-0d8217e4-d885-4851-a535-1b27279cb01f-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:03:05 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-e878fd0e-ccb7-4ba2-b789-3729b68b32c7 tempest-TestStampPattern-1012733486 None] Lock "cinder-0d8217e4-d885-4851-a535-1b27279cb01f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:03:05 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-e878fd0e-ccb7-4ba2-b789-3729b68b32c7 tempest-TestStampPattern-1012733486 None] Acquiring lock "cinder-quobyte-036399b6-86ab-420a-acc9-beb79c566c89" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:03:05 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-e878fd0e-ccb7-4ba2-b789-3729b68b32c7 tempest-TestStampPattern-1012733486 None] Lock "cinder-quobyte-036399b6-86ab-420a-acc9-beb79c566c89" acquired by "delete_snapshot" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:03:05 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-e878fd0e-ccb7-4ba2-b789-3729b68b32c7 tempest-TestStampPattern-1012733486 None] Acquiring lock "cinder-quobyte-0d8217e4-d885-4851-a535-1b27279cb01f" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:03:05 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-e878fd0e-ccb7-4ba2-b789-3729b68b32c7 tempest-TestStampPattern-1012733486 None] Lock "cinder-quobyte-0d8217e4-d885-4851-a535-1b27279cb01f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:03:05 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-e878fd0e-ccb7-4ba2-b789-3729b68b32c7 tempest-TestStampPattern-1012733486 None] Deleting offline snapshot 0d8217e4-d885-4851-a535-1b27279cb01f of volume 036399b6-86ab-420a-acc9-beb79c566c89 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 13:03:05 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-e878fd0e-ccb7-4ba2-b789-3729b68b32c7 tempest-TestStampPattern-1012733486 None] snapshot_file for this snap is: volume-036399b6-86ab-420a-acc9-beb79c566c89.0d8217e4-d885-4851-a535-1b27279cb01f {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 13:03:05 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a4463b-c28b-435a-88da-a91e5a880d86]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:03:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e878fd0e-ccb7-4ba2-b789-3729b68b32c7 tempest-TestStampPattern-1012733486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.0d8217e4-d885-4851-a535-1b27279cb01f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:05 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a256698f-6885-4a7e-a8ac-34a3d373c381 tempest-TestStampPattern-1012733486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.864s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:05 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-a256698f-6885-4a7e-a8ac-34a3d373c381 tempest-TestStampPattern-1012733486 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:03:05 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-a256698f-6885-4a7e-a8ac-34a3d373c381 tempest-TestStampPattern-1012733486 None] Deleted volume successfully.
Nov 19 13:03:05 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a256698f-6885-4a7e-a8ac-34a3d373c381 tempest-TestStampPattern-1012733486 None] Lock "cinder-ce116d3f-8b95-407b-b8e3-9d9b30ae4037-delete_volume" released by "delete_volume" :: held 2.972s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:03:05 devstack sudo[93751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.0d8217e4-d885-4851-a535-1b27279cb01f
Nov 19 13:03:05 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:06 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e878fd0e-ccb7-4ba2-b789-3729b68b32c7 tempest-TestStampPattern-1012733486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.0d8217e4-d885-4851-a535-1b27279cb01f" returned: 0 in 0.673s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-e878fd0e-ccb7-4ba2-b789-3729b68b32c7 tempest-TestStampPattern-1012733486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-036399b6-86ab-420a-acc9-beb79c566c89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:03:06 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[843c509c-8e0c-4604-8a22-87b974b3e442]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:03:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e878fd0e-ccb7-4ba2-b789-3729b68b32c7 tempest-TestStampPattern-1012733486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:06 devstack sudo[93758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89
Nov 19 13:03:06 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:07 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e878fd0e-ccb7-4ba2-b789-3729b68b32c7 tempest-TestStampPattern-1012733486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89" returned: 0 in 0.836s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e878fd0e-ccb7-4ba2-b789-3729b68b32c7 tempest-TestStampPattern-1012733486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.0d8217e4-d885-4851-a535-1b27279cb01f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:07 devstack sudo[93763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.0d8217e4-d885-4851-a535-1b27279cb01f
Nov 19 13:03:07 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:07 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:03:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Flow 'volume_create_manager' (10a9f817-3780-4bd4-9bb0-3ccd5f1790ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:03:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b34ef1-8401-4499-b6f1-359275777f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b34ef1-8401-4499-b6f1-359275777f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2138609797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da667de8-0023-4a16-a4f5-11bbfe1f8619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c336e0e3a3b4f4a8881f8fa0b540483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:03:08Z,use_quota=True,user_id='db7b372bf12b49e787a4c0471746f811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771eba7c-06c7-48d2-be80-cd356bdb0ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771eba7c-06c7-48d2-be80-cd356bdb0ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524ad931-d3e5-404b-87af-13d885bf68bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524ad931-d3e5-404b-87af-13d885bf68bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da667de8-0023-4a16-a4f5-11bbfe1f8619', 'volume_name': 'volume-da667de8-0023-4a16-a4f5-11bbfe1f8619', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4a88ac-d1a2-47bf-81d7-3d5a8702515f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4a88ac-d1a2-47bf-81d7-3d5a8702515f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76325465-cabf-4a72-9159-4ab5f423f10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:07 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Volume da667de8-0023-4a16-a4f5-11bbfe1f8619: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da667de8-0023-4a16-a4f5-11bbfe1f8619', 'volume_size': 1}
Nov 19 13:03:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2138609797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da667de8-0023-4a16-a4f5-11bbfe1f8619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c336e0e3a3b4f4a8881f8fa0b540483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:03:08Z,use_quota=True,user_id='db7b372bf12b49e787a4c0471746f811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:03:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Creating volume da667de8-0023-4a16-a4f5-11bbfe1f8619 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:03:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:03:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:03:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:03:07 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:03:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da667de8-0023-4a16-a4f5-11bbfe1f8619 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:08 devstack sudo[93768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da667de8-0023-4a16-a4f5-11bbfe1f8619 1073741824
Nov 19 13:03:08 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:08 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e878fd0e-ccb7-4ba2-b789-3729b68b32c7 tempest-TestStampPattern-1012733486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.0d8217e4-d885-4851-a535-1b27279cb01f" returned: 0 in 0.855s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e878fd0e-ccb7-4ba2-b789-3729b68b32c7 tempest-TestStampPattern-1012733486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.0d8217e4-d885-4851-a535-1b27279cb01f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:08 devstack sudo[93770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.0d8217e4-d885-4851-a535-1b27279cb01f
Nov 19 13:03:08 devstack sudo[93770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:08 devstack sudo[93770]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e878fd0e-ccb7-4ba2-b789-3729b68b32c7 tempest-TestStampPattern-1012733486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89.0d8217e4-d885-4851-a535-1b27279cb01f" returned: 0 in 0.500s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:08 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-e878fd0e-ccb7-4ba2-b789-3729b68b32c7 tempest-TestStampPattern-1012733486 None] Lock "cinder-quobyte-0d8217e4-d885-4851-a535-1b27279cb01f" released by "_delete_snapshot" :: held 2.988s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:03:08 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-e878fd0e-ccb7-4ba2-b789-3729b68b32c7 tempest-TestStampPattern-1012733486 None] Lock "cinder-quobyte-036399b6-86ab-420a-acc9-beb79c566c89" released by "delete_snapshot" :: held 3.007s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:03:08 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da667de8-0023-4a16-a4f5-11bbfe1f8619 1073741824" returned: 0 in 0.764s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da667de8-0023-4a16-a4f5-11bbfe1f8619 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:08 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-e878fd0e-ccb7-4ba2-b789-3729b68b32c7 tempest-TestStampPattern-1012733486 None] Created reservations ['696e7cd4-eda8-40c0-bc0c-b730cfefaa5d', 'ddc90594-ab43-49d4-8d98-bce81d0a647f', '56a36b8a-9d24-41ab-870a-1d2d6b7d89db', '61c0484e-7c76-4dac-adf2-90c0730e9344'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:03:08 devstack sudo[93776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da667de8-0023-4a16-a4f5-11bbfe1f8619
Nov 19 13:03:08 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:08 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-e878fd0e-ccb7-4ba2-b789-3729b68b32c7 tempest-TestStampPattern-1012733486 None] Delete snapshot completed successfully.
Nov 19 13:03:08 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-e878fd0e-ccb7-4ba2-b789-3729b68b32c7 tempest-TestStampPattern-1012733486 None] Lock "cinder-0d8217e4-d885-4851-a535-1b27279cb01f-delete_snapshot" released by "delete_snapshot" :: held 3.174s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:03:09 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da667de8-0023-4a16-a4f5-11bbfe1f8619" returned: 0 in 0.712s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:09 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:03:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76325465-cabf-4a72-9159-4ab5f423f10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da667de8-0023-4a16-a4f5-11bbfe1f8619', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d7bb0c-1e95-4f74-ba07-bd8dc8612d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:09 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Volume volume-da667de8-0023-4a16-a4f5-11bbfe1f8619 (da667de8-0023-4a16-a4f5-11bbfe1f8619): created successfully
Nov 19 13:03:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d7bb0c-1e95-4f74-ba07-bd8dc8612d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Flow 'volume_create_manager' (10a9f817-3780-4bd4-9bb0-3ccd5f1790ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:03:09 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-8389280b-c402-4fe8-9729-e3782db7affb tempest-TestMinimumBasicScenario-1631171406 None] Created volume successfully.
Nov 19 13:03:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-a1033c21-b4b8-41af-926e-a5a79800fe92 req-b6a8a572-d5a6-4fbf-a80b-d3531748a5a4 tempest-TestMinimumBasicScenario-1631171406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-a1033c21-b4b8-41af-926e-a5a79800fe92 req-b6a8a572-d5a6-4fbf-a80b-d3531748a5a4 tempest-TestMinimumBasicScenario-1631171406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:13 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2066584a-8664-4c6d-bf51-eaafe501d92c]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:03:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-a1033c21-b4b8-41af-926e-a5a79800fe92 req-b6a8a572-d5a6-4fbf-a80b-d3531748a5a4 tempest-TestMinimumBasicScenario-1631171406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da667de8-0023-4a16-a4f5-11bbfe1f8619 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:13 devstack sudo[93830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da667de8-0023-4a16-a4f5-11bbfe1f8619
Nov 19 13:03:13 devstack sudo[93830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:13 devstack sudo[93830]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-a1033c21-b4b8-41af-926e-a5a79800fe92 req-b6a8a572-d5a6-4fbf-a80b-d3531748a5a4 tempest-TestMinimumBasicScenario-1631171406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da667de8-0023-4a16-a4f5-11bbfe1f8619" returned: 0 in 0.772s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-a1033c21-b4b8-41af-926e-a5a79800fe92 req-b6a8a572-d5a6-4fbf-a80b-d3531748a5a4 tempest-TestMinimumBasicScenario-1631171406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.785s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:14 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-a1033c21-b4b8-41af-926e-a5a79800fe92 req-b6a8a572-d5a6-4fbf-a80b-d3531748a5a4 tempest-TestMinimumBasicScenario-1631171406 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-da667de8-0023-4a16-a4f5-11bbfe1f8619', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a2a1f661-53e3-49a6-94ea-585394041fe1', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 13:03:14 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-a1033c21-b4b8-41af-926e-a5a79800fe92 req-b6a8a572-d5a6-4fbf-a80b-d3531748a5a4 tempest-TestMinimumBasicScenario-1631171406 None] attachment_update completed successfully.
Nov 19 13:03:16 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-20d559b8-cf50-4f30-b0e3-b41c2d856140 tempest-TestStampPattern-1012733486 None] Acquiring lock "cinder-036399b6-86ab-420a-acc9-beb79c566c89-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:03:16 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-20d559b8-cf50-4f30-b0e3-b41c2d856140 tempest-TestStampPattern-1012733486 None] Lock "cinder-036399b6-86ab-420a-acc9-beb79c566c89-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:03:16 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-20d559b8-cf50-4f30-b0e3-b41c2d856140 tempest-TestStampPattern-1012733486 None] Acquiring lock "cinder-quobyte-036399b6-86ab-420a-acc9-beb79c566c89" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:03:16 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-20d559b8-cf50-4f30-b0e3-b41c2d856140 tempest-TestStampPattern-1012733486 None] Lock "cinder-quobyte-036399b6-86ab-420a-acc9-beb79c566c89" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:03:16 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a0b0d8-6ddf-4ac2-816a-a8ec31602a3a]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:03:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-20d559b8-cf50-4f30-b0e3-b41c2d856140 tempest-TestStampPattern-1012733486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:16 devstack sudo[93840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89
Nov 19 13:03:16 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:16 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-20d559b8-cf50-4f30-b0e3-b41c2d856140 tempest-TestStampPattern-1012733486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89" returned: 0 in 0.626s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-20d559b8-cf50-4f30-b0e3-b41c2d856140 tempest-TestStampPattern-1012733486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:16 devstack sudo[93845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89
Nov 19 13:03:16 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:17 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-20d559b8-cf50-4f30-b0e3-b41c2d856140 tempest-TestStampPattern-1012733486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-036399b6-86ab-420a-acc9-beb79c566c89" returned: 0 in 0.481s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:17 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-20d559b8-cf50-4f30-b0e3-b41c2d856140 tempest-TestStampPattern-1012733486 None] Lock "cinder-quobyte-036399b6-86ab-420a-acc9-beb79c566c89" released by "delete_volume" :: held 1.156s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:03:17 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-20d559b8-cf50-4f30-b0e3-b41c2d856140 tempest-TestStampPattern-1012733486 None] Created reservations ['d4a24067-ea20-4888-bc7d-b50770fb722e', 'c212ae10-77b2-406d-a3e1-dadc643fa239', 'c390bf31-2767-490a-9316-4ddcb3b20b56', 'ee9017c7-3204-4c05-a1d0-95599e52afbc'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:03:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-20d559b8-cf50-4f30-b0e3-b41c2d856140 tempest-TestStampPattern-1012733486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-20d559b8-cf50-4f30-b0e3-b41c2d856140 tempest-TestStampPattern-1012733486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-20d559b8-cf50-4f30-b0e3-b41c2d856140 tempest-TestStampPattern-1012733486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:03:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-20d559b8-cf50-4f30-b0e3-b41c2d856140 tempest-TestStampPattern-1012733486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:03:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-20d559b8-cf50-4f30-b0e3-b41c2d856140 tempest-TestStampPattern-1012733486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-20d559b8-cf50-4f30-b0e3-b41c2d856140 tempest-TestStampPattern-1012733486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:17 devstack sudo[93848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:03:17 devstack sudo[93848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:18 devstack sudo[93848]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-20d559b8-cf50-4f30-b0e3-b41c2d856140 tempest-TestStampPattern-1012733486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.543s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:18 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-20d559b8-cf50-4f30-b0e3-b41c2d856140 tempest-TestStampPattern-1012733486 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:03:18 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-20d559b8-cf50-4f30-b0e3-b41c2d856140 tempest-TestStampPattern-1012733486 None] Deleted volume successfully.
Nov 19 13:03:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-20d559b8-cf50-4f30-b0e3-b41c2d856140 tempest-TestStampPattern-1012733486 None] Lock "cinder-036399b6-86ab-420a-acc9-beb79c566c89-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:03:27 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:03:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Flow 'volume_create_manager' (b19c7f15-f1e3-4a72-8ade-0fb261e9526e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:03:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a2b02e-e0a9-4f33-86d7-29f9c096dc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a2b02e-e0a9-4f33-86d7-29f9c096dc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-150384995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=397f9811-45b8-4f4a-83fd-417fdd2621b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45b1ff529ad4165990245c91d1a1c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:03:28Z,use_quota=True,user_id='e3ebce1302f7474eb24991268543bb80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd409e40-a251-4b40-8854-178302849954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd409e40-a251-4b40-8854-178302849954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c650f254-9238-4281-aca2-61f2da73616c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c650f254-9238-4281-aca2-61f2da73616c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '397f9811-45b8-4f4a-83fd-417fdd2621b1', 'volume_name': 'volume-397f9811-45b8-4f4a-83fd-417fdd2621b1', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9084d87f-5417-426e-af8c-1c0276865448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9084d87f-5417-426e-af8c-1c0276865448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4d5e33f-d7e7-4b71-a9e2-537a7ca2ba82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:27 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Volume 397f9811-45b8-4f4a-83fd-417fdd2621b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-397f9811-45b8-4f4a-83fd-417fdd2621b1', 'volume_size': 1}
Nov 19 13:03:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:27 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-150384995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=397f9811-45b8-4f4a-83fd-417fdd2621b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45b1ff529ad4165990245c91d1a1c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:03:28Z,use_quota=True,user_id='e3ebce1302f7474eb24991268543bb80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:03:27 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Creating volume 397f9811-45b8-4f4a-83fd-417fdd2621b1 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:03:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:27 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:03:27 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:03:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:27 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:03:27 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:03:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-397f9811-45b8-4f4a-83fd-417fdd2621b1 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:27 devstack sudo[93864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-397f9811-45b8-4f4a-83fd-417fdd2621b1 1073741824
Nov 19 13:03:27 devstack sudo[93864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Flow 'volume_create_manager' (73dbdc57-722e-4d88-91c1-a677be18d24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (610ca886-d3a3-4710-a04f-55f5598b398e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (610ca886-d3a3-4710-a04f-55f5598b398e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1337738198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee657720-3f4b-41e8-8f90-144847d276d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45b1ff529ad4165990245c91d1a1c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:03:28Z,use_quota=True,user_id='e3ebce1302f7474eb24991268543bb80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a40ac3-31db-4086-a3fa-d3404f870861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a40ac3-31db-4086-a3fa-d3404f870861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c22c58-c281-4ce4-ab3e-43c2e5fe012c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c22c58-c281-4ce4-ab3e-43c2e5fe012c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee657720-3f4b-41e8-8f90-144847d276d1', 'volume_name': 'volume-ee657720-3f4b-41e8-8f90-144847d276d1', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dde3db0-0b2e-4172-91aa-3986d994972c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dde3db0-0b2e-4172-91aa-3986d994972c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c7a1448-d582-47fb-b604-e8f95bcfc36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:28 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Volume ee657720-3f4b-41e8-8f90-144847d276d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee657720-3f4b-41e8-8f90-144847d276d1', 'volume_size': 1}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Flow 'volume_create_manager' (da06f442-528c-467e-84ac-526c5ad03995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646d44ee-4c83-44d1-a7d1-1b469c4419c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646d44ee-4c83-44d1-a7d1-1b469c4419c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-248139469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f8f18b-fb23-4902-99f6-ed0ebeec23e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45b1ff529ad4165990245c91d1a1c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:03:28Z,use_quota=True,user_id='e3ebce1302f7474eb24991268543bb80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c6759d8-93b9-4114-8551-48d4d107dd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c6759d8-93b9-4114-8551-48d4d107dd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6cc0516-6f78-4882-b22a-ab0ba1b7ee85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6cc0516-6f78-4882-b22a-ab0ba1b7ee85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5f8f18b-fb23-4902-99f6-ed0ebeec23e5', 'volume_name': 'volume-c5f8f18b-fb23-4902-99f6-ed0ebeec23e5', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76ccebb-0c79-4f8d-a903-99ce3c80da22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76ccebb-0c79-4f8d-a903-99ce3c80da22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70ce6201-224c-43ea-8b0a-690fdb988324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:28 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Volume c5f8f18b-fb23-4902-99f6-ed0ebeec23e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5f8f18b-fb23-4902-99f6-ed0ebeec23e5', 'volume_size': 1}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Flow 'volume_create_manager' (48a276fc-fa2b-4ef1-a3d4-90f0a7c1cc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6566ec33-15e5-470e-b660-2d235d22d152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6566ec33-15e5-470e-b660-2d235d22d152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-690710855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb015ac-7a14-40c5-8ef4-cbb8a31af66d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45b1ff529ad4165990245c91d1a1c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:03:29Z,use_quota=True,user_id='e3ebce1302f7474eb24991268543bb80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f311c4a9-8d00-4960-b8db-98885846f09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f311c4a9-8d00-4960-b8db-98885846f09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f71943c-bf72-4dcd-b277-67eb69a801f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f71943c-bf72-4dcd-b277-67eb69a801f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeb015ac-7a14-40c5-8ef4-cbb8a31af66d', 'volume_name': 'volume-eeb015ac-7a14-40c5-8ef4-cbb8a31af66d', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272784c6-2bbd-4bb8-b6ee-4d0959c520b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272784c6-2bbd-4bb8-b6ee-4d0959c520b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f702f1-1847-41cd-9001-9c2508773503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:28 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Volume eeb015ac-7a14-40c5-8ef4-cbb8a31af66d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeb015ac-7a14-40c5-8ef4-cbb8a31af66d', 'volume_size': 1}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:03:28 devstack sudo[93864]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Flow 'volume_create_manager' (34915740-592e-4e2f-82c0-3d2a7b553c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033422db-de7c-4676-85c2-28981914a738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-397f9811-45b8-4f4a-83fd-417fdd2621b1 1073741824" returned: 0 in 1.181s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-397f9811-45b8-4f4a-83fd-417fdd2621b1 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:29 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033422db-de7c-4676-85c2-28981914a738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1106666748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45b1ff529ad4165990245c91d1a1c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:03:29Z,use_quota=True,user_id='e3ebce1302f7474eb24991268543bb80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:29 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9f4be7-8ec2-4020-977a-8c8e46a97cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:29 devstack sudo[93871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-397f9811-45b8-4f4a-83fd-417fdd2621b1
Nov 19 13:03:29 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:29 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9f4be7-8ec2-4020-977a-8c8e46a97cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:29 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e413bca9-ac56-4188-ade7-a8eaa13363d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:29 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e413bca9-ac56-4188-ade7-a8eaa13363d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1', 'volume_name': 'volume-ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:29 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f3f1ef-1e3e-419b-8afe-d6e4f4c87cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:29 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f3f1ef-1e3e-419b-8afe-d6e4f4c87cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:29 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba02e4a-b2e5-4558-b7c8-7bff6da86e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:29 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Volume ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1', 'volume_size': 1}
Nov 19 13:03:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:29 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-397f9811-45b8-4f4a-83fd-417fdd2621b1" returned: 0 in 0.497s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:29 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:03:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.338s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:29 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1337738198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee657720-3f4b-41e8-8f90-144847d276d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45b1ff529ad4165990245c91d1a1c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:03:28Z,use_quota=True,user_id='e3ebce1302f7474eb24991268543bb80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:03:29 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Creating volume ee657720-3f4b-41e8-8f90-144847d276d1 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:03:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:29 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:03:29 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:03:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:29 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:03:29 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:03:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee657720-3f4b-41e8-8f90-144847d276d1 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:29 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4d5e33f-d7e7-4b71-a9e2-537a7ca2ba82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-397f9811-45b8-4f4a-83fd-417fdd2621b1', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:29 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e569c4-2c89-4cfb-91b2-1096fcc90099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:29 devstack sudo[93876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee657720-3f4b-41e8-8f90-144847d276d1 1073741824
Nov 19 13:03:29 devstack sudo[93876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:29 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Volume volume-397f9811-45b8-4f4a-83fd-417fdd2621b1 (397f9811-45b8-4f4a-83fd-417fdd2621b1): created successfully
Nov 19 13:03:29 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e569c4-2c89-4cfb-91b2-1096fcc90099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:29 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Flow 'volume_create_manager' (b19c7f15-f1e3-4a72-8ade-0fb261e9526e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:03:29 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-433186dd-158a-4c13-8569-5aa8c9a61198 tempest-CreateVolumesFromImageTest-1090382102 None] Created volume successfully.
Nov 19 13:03:30 devstack sudo[93876]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee657720-3f4b-41e8-8f90-144847d276d1 1073741824" returned: 0 in 0.685s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee657720-3f4b-41e8-8f90-144847d276d1 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:30 devstack sudo[93883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee657720-3f4b-41e8-8f90-144847d276d1
Nov 19 13:03:30 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:30 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee657720-3f4b-41e8-8f90-144847d276d1" returned: 0 in 0.482s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:03:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.236s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-248139469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f8f18b-fb23-4902-99f6-ed0ebeec23e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45b1ff529ad4165990245c91d1a1c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:03:28Z,use_quota=True,user_id='e3ebce1302f7474eb24991268543bb80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:03:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Creating volume c5f8f18b-fb23-4902-99f6-ed0ebeec23e5 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:03:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:03:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:03:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:03:30 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:03:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c5f8f18b-fb23-4902-99f6-ed0ebeec23e5 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c7a1448-d582-47fb-b604-e8f95bcfc36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee657720-3f4b-41e8-8f90-144847d276d1', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1556db-e67e-4859-ba69-ca785eb5167c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:30 devstack sudo[93891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c5f8f18b-fb23-4902-99f6-ed0ebeec23e5 1073741824
Nov 19 13:03:30 devstack sudo[93891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:30 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Volume volume-ee657720-3f4b-41e8-8f90-144847d276d1 (ee657720-3f4b-41e8-8f90-144847d276d1): created successfully
Nov 19 13:03:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1556db-e67e-4859-ba69-ca785eb5167c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Flow 'volume_create_manager' (73dbdc57-722e-4d88-91c1-a677be18d24a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:03:30 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-c400b3c7-3e16-4e4c-bc6a-0c6bb02f75b3 tempest-CreateVolumesFromImageTest-1090382102 None] Created volume successfully.
Nov 19 13:03:31 devstack sudo[93891]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c5f8f18b-fb23-4902-99f6-ed0ebeec23e5 1073741824" returned: 0 in 0.640s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c5f8f18b-fb23-4902-99f6-ed0ebeec23e5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:31 devstack sudo[93900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c5f8f18b-fb23-4902-99f6-ed0ebeec23e5
Nov 19 13:03:31 devstack sudo[93900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:31 devstack sudo[93900]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c5f8f18b-fb23-4902-99f6-ed0ebeec23e5" returned: 0 in 0.482s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:03:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.140s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-690710855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb015ac-7a14-40c5-8ef4-cbb8a31af66d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45b1ff529ad4165990245c91d1a1c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:03:29Z,use_quota=True,user_id='e3ebce1302f7474eb24991268543bb80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:03:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Creating volume eeb015ac-7a14-40c5-8ef4-cbb8a31af66d {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:03:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:03:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:03:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:03:31 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:03:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-eeb015ac-7a14-40c5-8ef4-cbb8a31af66d 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70ce6201-224c-43ea-8b0a-690fdb988324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5f8f18b-fb23-4902-99f6-ed0ebeec23e5', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c67c1e-b592-4504-b36b-52e58b1727b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:31 devstack sudo[93905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-eeb015ac-7a14-40c5-8ef4-cbb8a31af66d 1073741824
Nov 19 13:03:31 devstack sudo[93905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:31 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Volume volume-c5f8f18b-fb23-4902-99f6-ed0ebeec23e5 (c5f8f18b-fb23-4902-99f6-ed0ebeec23e5): created successfully
Nov 19 13:03:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c67c1e-b592-4504-b36b-52e58b1727b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Flow 'volume_create_manager' (da06f442-528c-467e-84ac-526c5ad03995) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:03:31 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-1846489a-a33b-402a-b4ef-b53c3528a24d tempest-CreateVolumesFromImageTest-1090382102 None] Created volume successfully.
Nov 19 13:03:32 devstack sudo[93905]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-eeb015ac-7a14-40c5-8ef4-cbb8a31af66d 1073741824" returned: 0 in 0.609s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-eeb015ac-7a14-40c5-8ef4-cbb8a31af66d {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:32 devstack sudo[93917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-eeb015ac-7a14-40c5-8ef4-cbb8a31af66d
Nov 19 13:03:32 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:32 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-eeb015ac-7a14-40c5-8ef4-cbb8a31af66d" returned: 0 in 0.457s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:32 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:03:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.868s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:32 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1106666748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45b1ff529ad4165990245c91d1a1c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:03:29Z,use_quota=True,user_id='e3ebce1302f7474eb24991268543bb80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:03:32 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Creating volume ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:03:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:32 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:03:32 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:03:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:32 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:03:32 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:03:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:32 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f702f1-1847-41cd-9001-9c2508773503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeb015ac-7a14-40c5-8ef4-cbb8a31af66d', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:32 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a614a16-8f6e-456c-ab57-a1df224f8846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:32 devstack sudo[93923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1 1073741824
Nov 19 13:03:32 devstack sudo[93923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:32 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Volume volume-eeb015ac-7a14-40c5-8ef4-cbb8a31af66d (eeb015ac-7a14-40c5-8ef4-cbb8a31af66d): created successfully
Nov 19 13:03:32 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a614a16-8f6e-456c-ab57-a1df224f8846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:32 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Flow 'volume_create_manager' (48a276fc-fa2b-4ef1-a3d4-90f0a7c1cc32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:03:32 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-7140f0ac-1a0b-40a9-a25a-70208c9ea948 tempest-CreateVolumesFromImageTest-1090382102 None] Created volume successfully.
Nov 19 13:03:33 devstack sudo[93923]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1 1073741824" returned: 0 in 0.750s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:33 devstack sudo[93967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1
Nov 19 13:03:33 devstack sudo[93967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:34 devstack sudo[93967]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1" returned: 0 in 0.444s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:34 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:03:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:34 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba02e4a-b2e5-4558-b7c8-7bff6da86e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:34 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13f0891-ccdc-458b-bcda-5d6a01dabcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:34 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Volume volume-ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1 (ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1): created successfully
Nov 19 13:03:34 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13f0891-ccdc-458b-bcda-5d6a01dabcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:34 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Flow 'volume_create_manager' (34915740-592e-4e2f-82c0-3d2a7b553c72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:03:34 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-92cabf73-645c-4f8b-9b09-fb989291a3ef tempest-CreateVolumesFromImageTest-1090382102 None] Created volume successfully.
Nov 19 13:03:34 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c284d65f-ef5e-4521-b5d4-9eacb706c411 tempest-CreateVolumesFromImageTest-1090382102 None] Acquiring lock "cinder-ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:03:34 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c284d65f-ef5e-4521-b5d4-9eacb706c411 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "cinder-ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:03:34 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c284d65f-ef5e-4521-b5d4-9eacb706c411 tempest-CreateVolumesFromImageTest-1090382102 None] Acquiring lock "cinder-quobyte-ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:03:34 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c284d65f-ef5e-4521-b5d4-9eacb706c411 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "cinder-quobyte-ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:03:34 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fc91d1-709d-48e9-90d2-66d80357d22c]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:03:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c284d65f-ef5e-4521-b5d4-9eacb706c411 tempest-CreateVolumesFromImageTest-1090382102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:34 devstack sudo[93989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1
Nov 19 13:03:34 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:35 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c284d65f-ef5e-4521-b5d4-9eacb706c411 tempest-CreateVolumesFromImageTest-1090382102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1" returned: 0 in 0.590s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c284d65f-ef5e-4521-b5d4-9eacb706c411 tempest-CreateVolumesFromImageTest-1090382102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:35 devstack sudo[94001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1
Nov 19 13:03:35 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:35 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c284d65f-ef5e-4521-b5d4-9eacb706c411 tempest-CreateVolumesFromImageTest-1090382102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1" returned: 0 in 0.456s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:35 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c284d65f-ef5e-4521-b5d4-9eacb706c411 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "cinder-quobyte-ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1" released by "delete_volume" :: held 1.074s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:03:35 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-c284d65f-ef5e-4521-b5d4-9eacb706c411 tempest-CreateVolumesFromImageTest-1090382102 None] Created reservations ['d3a148dd-4f7e-4bc3-9d76-969aba4e0ae0', 'c7543186-a4cd-4be3-acf0-d9eefab3608e', 'dc976999-c61e-4476-acf3-160b3ec89c1b', 'c2bdf31b-ce0a-4669-8b4d-e9eece1fb43f'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:03:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c284d65f-ef5e-4521-b5d4-9eacb706c411 tempest-CreateVolumesFromImageTest-1090382102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c284d65f-ef5e-4521-b5d4-9eacb706c411 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:35 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c284d65f-ef5e-4521-b5d4-9eacb706c411 tempest-CreateVolumesFromImageTest-1090382102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:03:35 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c284d65f-ef5e-4521-b5d4-9eacb706c411 tempest-CreateVolumesFromImageTest-1090382102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:03:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c284d65f-ef5e-4521-b5d4-9eacb706c411 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c284d65f-ef5e-4521-b5d4-9eacb706c411 tempest-CreateVolumesFromImageTest-1090382102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:35 devstack sudo[94004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:03:35 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:36 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c284d65f-ef5e-4521-b5d4-9eacb706c411 tempest-CreateVolumesFromImageTest-1090382102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.489s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:36 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-c284d65f-ef5e-4521-b5d4-9eacb706c411 tempest-CreateVolumesFromImageTest-1090382102 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:03:36 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-c284d65f-ef5e-4521-b5d4-9eacb706c411 tempest-CreateVolumesFromImageTest-1090382102 None] Deleted volume successfully.
Nov 19 13:03:36 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c284d65f-ef5e-4521-b5d4-9eacb706c411 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "cinder-ebf49bf9-6c64-4ad0-acfc-460d6bc7efe1-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:03:36 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-533c3ca4-6f0d-4686-8a13-1a498c25993c tempest-CreateVolumesFromImageTest-1090382102 None] Acquiring lock "cinder-eeb015ac-7a14-40c5-8ef4-cbb8a31af66d-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:03:36 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-533c3ca4-6f0d-4686-8a13-1a498c25993c tempest-CreateVolumesFromImageTest-1090382102 None] Lock "cinder-eeb015ac-7a14-40c5-8ef4-cbb8a31af66d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:03:36 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-533c3ca4-6f0d-4686-8a13-1a498c25993c tempest-CreateVolumesFromImageTest-1090382102 None] Acquiring lock "cinder-quobyte-eeb015ac-7a14-40c5-8ef4-cbb8a31af66d" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:03:36 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-533c3ca4-6f0d-4686-8a13-1a498c25993c tempest-CreateVolumesFromImageTest-1090382102 None] Lock "cinder-quobyte-eeb015ac-7a14-40c5-8ef4-cbb8a31af66d" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:03:36 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a846fa4a-1b23-4d45-979e-846c0c3241ae]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:03:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-533c3ca4-6f0d-4686-8a13-1a498c25993c tempest-CreateVolumesFromImageTest-1090382102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-eeb015ac-7a14-40c5-8ef4-cbb8a31af66d {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:36 devstack sudo[94007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-eeb015ac-7a14-40c5-8ef4-cbb8a31af66d
Nov 19 13:03:36 devstack sudo[94007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:37 devstack sudo[94007]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-533c3ca4-6f0d-4686-8a13-1a498c25993c tempest-CreateVolumesFromImageTest-1090382102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-eeb015ac-7a14-40c5-8ef4-cbb8a31af66d" returned: 0 in 0.569s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-533c3ca4-6f0d-4686-8a13-1a498c25993c tempest-CreateVolumesFromImageTest-1090382102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-eeb015ac-7a14-40c5-8ef4-cbb8a31af66d {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:37 devstack sudo[94012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-eeb015ac-7a14-40c5-8ef4-cbb8a31af66d
Nov 19 13:03:37 devstack sudo[94012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:37 devstack sudo[94012]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-533c3ca4-6f0d-4686-8a13-1a498c25993c tempest-CreateVolumesFromImageTest-1090382102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-eeb015ac-7a14-40c5-8ef4-cbb8a31af66d" returned: 0 in 0.514s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:37 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-533c3ca4-6f0d-4686-8a13-1a498c25993c tempest-CreateVolumesFromImageTest-1090382102 None] Lock "cinder-quobyte-eeb015ac-7a14-40c5-8ef4-cbb8a31af66d" released by "delete_volume" :: held 1.116s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:03:37 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-533c3ca4-6f0d-4686-8a13-1a498c25993c tempest-CreateVolumesFromImageTest-1090382102 None] Created reservations ['b5cc9823-08e5-46d5-bc3f-f0ed3f097fcb', '8f7f1fea-1e7e-4063-9ee4-a336b5674690', 'e7425799-dc36-4def-85e9-b0729e5554de', '8c98e400-5b97-4117-97ce-b6b01c8b13bd'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:03:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-533c3ca4-6f0d-4686-8a13-1a498c25993c tempest-CreateVolumesFromImageTest-1090382102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-533c3ca4-6f0d-4686-8a13-1a498c25993c tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:38 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-533c3ca4-6f0d-4686-8a13-1a498c25993c tempest-CreateVolumesFromImageTest-1090382102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:03:38 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-533c3ca4-6f0d-4686-8a13-1a498c25993c tempest-CreateVolumesFromImageTest-1090382102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:03:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-533c3ca4-6f0d-4686-8a13-1a498c25993c tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-533c3ca4-6f0d-4686-8a13-1a498c25993c tempest-CreateVolumesFromImageTest-1090382102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:38 devstack sudo[94016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:03:38 devstack sudo[94016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:38 devstack sudo[94016]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-533c3ca4-6f0d-4686-8a13-1a498c25993c tempest-CreateVolumesFromImageTest-1090382102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.467s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:38 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-533c3ca4-6f0d-4686-8a13-1a498c25993c tempest-CreateVolumesFromImageTest-1090382102 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:03:38 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-533c3ca4-6f0d-4686-8a13-1a498c25993c tempest-CreateVolumesFromImageTest-1090382102 None] Deleted volume successfully.
Nov 19 13:03:38 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-533c3ca4-6f0d-4686-8a13-1a498c25993c tempest-CreateVolumesFromImageTest-1090382102 None] Lock "cinder-eeb015ac-7a14-40c5-8ef4-cbb8a31af66d-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:03:38 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8dff5a2f-e1e6-4115-923a-da1edc6b39c2 tempest-CreateVolumesFromImageTest-1090382102 None] Acquiring lock "cinder-c5f8f18b-fb23-4902-99f6-ed0ebeec23e5-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:03:38 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8dff5a2f-e1e6-4115-923a-da1edc6b39c2 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "cinder-c5f8f18b-fb23-4902-99f6-ed0ebeec23e5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:03:38 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=39,cinder:UPDATE=50,cinder:INSERT=11,cinder:DELETE=6 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:03:38 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=50,cinder:UPDATE=57,cinder:INSERT=9,cinder:DELETE=4 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:03:38 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8dff5a2f-e1e6-4115-923a-da1edc6b39c2 tempest-CreateVolumesFromImageTest-1090382102 None] Acquiring lock "cinder-quobyte-c5f8f18b-fb23-4902-99f6-ed0ebeec23e5" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:03:39 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8dff5a2f-e1e6-4115-923a-da1edc6b39c2 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "cinder-quobyte-c5f8f18b-fb23-4902-99f6-ed0ebeec23e5" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:03:39 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[598e804c-f357-48aa-982b-13028f725b06]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:03:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dff5a2f-e1e6-4115-923a-da1edc6b39c2 tempest-CreateVolumesFromImageTest-1090382102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c5f8f18b-fb23-4902-99f6-ed0ebeec23e5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:39 devstack sudo[94019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c5f8f18b-fb23-4902-99f6-ed0ebeec23e5
Nov 19 13:03:39 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:39 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dff5a2f-e1e6-4115-923a-da1edc6b39c2 tempest-CreateVolumesFromImageTest-1090382102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c5f8f18b-fb23-4902-99f6-ed0ebeec23e5" returned: 0 in 0.553s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dff5a2f-e1e6-4115-923a-da1edc6b39c2 tempest-CreateVolumesFromImageTest-1090382102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c5f8f18b-fb23-4902-99f6-ed0ebeec23e5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:39 devstack sudo[94027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c5f8f18b-fb23-4902-99f6-ed0ebeec23e5
Nov 19 13:03:39 devstack sudo[94027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:40 devstack sudo[94027]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dff5a2f-e1e6-4115-923a-da1edc6b39c2 tempest-CreateVolumesFromImageTest-1090382102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c5f8f18b-fb23-4902-99f6-ed0ebeec23e5" returned: 0 in 0.431s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:40 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8dff5a2f-e1e6-4115-923a-da1edc6b39c2 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "cinder-quobyte-c5f8f18b-fb23-4902-99f6-ed0ebeec23e5" released by "delete_volume" :: held 1.017s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:03:40 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-8dff5a2f-e1e6-4115-923a-da1edc6b39c2 tempest-CreateVolumesFromImageTest-1090382102 None] Created reservations ['99faac52-2bd3-4d7e-9b95-2e1ec5f81ec8', 'be579432-0b4b-4aa9-a902-df341bae391e', '10addf40-4875-430b-ac95-5979643b5e0e', '84bdc6dd-d431-4167-ac4f-92712b8be05b'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:03:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8dff5a2f-e1e6-4115-923a-da1edc6b39c2 tempest-CreateVolumesFromImageTest-1090382102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8dff5a2f-e1e6-4115-923a-da1edc6b39c2 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:40 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8dff5a2f-e1e6-4115-923a-da1edc6b39c2 tempest-CreateVolumesFromImageTest-1090382102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:03:40 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8dff5a2f-e1e6-4115-923a-da1edc6b39c2 tempest-CreateVolumesFromImageTest-1090382102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:03:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8dff5a2f-e1e6-4115-923a-da1edc6b39c2 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dff5a2f-e1e6-4115-923a-da1edc6b39c2 tempest-CreateVolumesFromImageTest-1090382102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:40 devstack sudo[94032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:03:40 devstack sudo[94032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:40 devstack sudo[94032]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dff5a2f-e1e6-4115-923a-da1edc6b39c2 tempest-CreateVolumesFromImageTest-1090382102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.428s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:40 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-8dff5a2f-e1e6-4115-923a-da1edc6b39c2 tempest-CreateVolumesFromImageTest-1090382102 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:03:40 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-8dff5a2f-e1e6-4115-923a-da1edc6b39c2 tempest-CreateVolumesFromImageTest-1090382102 None] Deleted volume successfully.
Nov 19 13:03:40 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8dff5a2f-e1e6-4115-923a-da1edc6b39c2 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "cinder-c5f8f18b-fb23-4902-99f6-ed0ebeec23e5-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:03:41 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-de50e769-d3df-4cbe-91bf-7e9c05d85e67 tempest-CreateVolumesFromImageTest-1090382102 None] Acquiring lock "cinder-ee657720-3f4b-41e8-8f90-144847d276d1-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:03:41 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-de50e769-d3df-4cbe-91bf-7e9c05d85e67 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "cinder-ee657720-3f4b-41e8-8f90-144847d276d1-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:03:41 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-de50e769-d3df-4cbe-91bf-7e9c05d85e67 tempest-CreateVolumesFromImageTest-1090382102 None] Acquiring lock "cinder-quobyte-ee657720-3f4b-41e8-8f90-144847d276d1" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:03:41 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-de50e769-d3df-4cbe-91bf-7e9c05d85e67 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "cinder-quobyte-ee657720-3f4b-41e8-8f90-144847d276d1" acquired by "delete_volume" :: waited 0.015s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:03:41 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82eb8e3-502b-4548-abe7-4d6f7ebdaae7]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:03:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-de50e769-d3df-4cbe-91bf-7e9c05d85e67 tempest-CreateVolumesFromImageTest-1090382102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee657720-3f4b-41e8-8f90-144847d276d1 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:41 devstack sudo[94041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee657720-3f4b-41e8-8f90-144847d276d1
Nov 19 13:03:41 devstack sudo[94041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:41 devstack sudo[94041]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-de50e769-d3df-4cbe-91bf-7e9c05d85e67 tempest-CreateVolumesFromImageTest-1090382102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee657720-3f4b-41e8-8f90-144847d276d1" returned: 0 in 0.544s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-de50e769-d3df-4cbe-91bf-7e9c05d85e67 tempest-CreateVolumesFromImageTest-1090382102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee657720-3f4b-41e8-8f90-144847d276d1 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:41 devstack sudo[94048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee657720-3f4b-41e8-8f90-144847d276d1
Nov 19 13:03:41 devstack sudo[94048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:42 devstack sudo[94048]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-de50e769-d3df-4cbe-91bf-7e9c05d85e67 tempest-CreateVolumesFromImageTest-1090382102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee657720-3f4b-41e8-8f90-144847d276d1" returned: 0 in 0.468s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:42 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-de50e769-d3df-4cbe-91bf-7e9c05d85e67 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "cinder-quobyte-ee657720-3f4b-41e8-8f90-144847d276d1" released by "delete_volume" :: held 1.041s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:03:42 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-de50e769-d3df-4cbe-91bf-7e9c05d85e67 tempest-CreateVolumesFromImageTest-1090382102 None] Created reservations ['7d104084-9767-459d-8d8f-a4ed480894a6', '95a59688-a74e-48eb-b20a-18925c744006', 'bd332156-01e4-4db2-bf7d-c94898e1e340', 'ccbfa9ff-527b-4259-b731-3264b7daa939'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:03:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-de50e769-d3df-4cbe-91bf-7e9c05d85e67 tempest-CreateVolumesFromImageTest-1090382102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-de50e769-d3df-4cbe-91bf-7e9c05d85e67 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-de50e769-d3df-4cbe-91bf-7e9c05d85e67 tempest-CreateVolumesFromImageTest-1090382102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:03:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-de50e769-d3df-4cbe-91bf-7e9c05d85e67 tempest-CreateVolumesFromImageTest-1090382102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:03:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-de50e769-d3df-4cbe-91bf-7e9c05d85e67 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-de50e769-d3df-4cbe-91bf-7e9c05d85e67 tempest-CreateVolumesFromImageTest-1090382102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:42 devstack sudo[94054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:03:42 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:42 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-de50e769-d3df-4cbe-91bf-7e9c05d85e67 tempest-CreateVolumesFromImageTest-1090382102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.436s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:42 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-de50e769-d3df-4cbe-91bf-7e9c05d85e67 tempest-CreateVolumesFromImageTest-1090382102 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:03:42 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-de50e769-d3df-4cbe-91bf-7e9c05d85e67 tempest-CreateVolumesFromImageTest-1090382102 None] Deleted volume successfully.
Nov 19 13:03:42 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-de50e769-d3df-4cbe-91bf-7e9c05d85e67 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "cinder-ee657720-3f4b-41e8-8f90-144847d276d1-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:03:43 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-bdd89e3e-8a0e-42e5-879a-f805b9a15297 tempest-CreateVolumesFromImageTest-1090382102 None] Acquiring lock "cinder-397f9811-45b8-4f4a-83fd-417fdd2621b1-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:03:43 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-bdd89e3e-8a0e-42e5-879a-f805b9a15297 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "cinder-397f9811-45b8-4f4a-83fd-417fdd2621b1-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:03:43 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-bdd89e3e-8a0e-42e5-879a-f805b9a15297 tempest-CreateVolumesFromImageTest-1090382102 None] Acquiring lock "cinder-quobyte-397f9811-45b8-4f4a-83fd-417fdd2621b1" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:03:43 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-bdd89e3e-8a0e-42e5-879a-f805b9a15297 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "cinder-quobyte-397f9811-45b8-4f4a-83fd-417fdd2621b1" acquired by "delete_volume" :: waited 0.025s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:03:43 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ebd48d-d98b-4066-a381-4f27b50d5658]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:03:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-bdd89e3e-8a0e-42e5-879a-f805b9a15297 tempest-CreateVolumesFromImageTest-1090382102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-397f9811-45b8-4f4a-83fd-417fdd2621b1 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:43 devstack sudo[94059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-397f9811-45b8-4f4a-83fd-417fdd2621b1
Nov 19 13:03:43 devstack sudo[94059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:43 devstack sudo[94059]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-bdd89e3e-8a0e-42e5-879a-f805b9a15297 tempest-CreateVolumesFromImageTest-1090382102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-397f9811-45b8-4f4a-83fd-417fdd2621b1" returned: 0 in 0.576s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-bdd89e3e-8a0e-42e5-879a-f805b9a15297 tempest-CreateVolumesFromImageTest-1090382102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-397f9811-45b8-4f4a-83fd-417fdd2621b1 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:44 devstack sudo[94064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-397f9811-45b8-4f4a-83fd-417fdd2621b1
Nov 19 13:03:44 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:44 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-bdd89e3e-8a0e-42e5-879a-f805b9a15297 tempest-CreateVolumesFromImageTest-1090382102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-397f9811-45b8-4f4a-83fd-417fdd2621b1" returned: 0 in 0.483s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:44 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-bdd89e3e-8a0e-42e5-879a-f805b9a15297 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "cinder-quobyte-397f9811-45b8-4f4a-83fd-417fdd2621b1" released by "delete_volume" :: held 1.092s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:03:44 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-bdd89e3e-8a0e-42e5-879a-f805b9a15297 tempest-CreateVolumesFromImageTest-1090382102 None] Created reservations ['5d31242a-de25-4b52-9011-238d5fc3ee0d', 'cb353f05-db0e-4c95-8f92-90eeab561280', '903e8c2f-4ecf-407b-9445-ac4de848e1ed', '61fc869f-561a-4aba-bf06-3c28e5a311a7'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:03:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-bdd89e3e-8a0e-42e5-879a-f805b9a15297 tempest-CreateVolumesFromImageTest-1090382102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-bdd89e3e-8a0e-42e5-879a-f805b9a15297 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:44 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-bdd89e3e-8a0e-42e5-879a-f805b9a15297 tempest-CreateVolumesFromImageTest-1090382102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:03:44 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-bdd89e3e-8a0e-42e5-879a-f805b9a15297 tempest-CreateVolumesFromImageTest-1090382102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:03:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-bdd89e3e-8a0e-42e5-879a-f805b9a15297 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-bdd89e3e-8a0e-42e5-879a-f805b9a15297 tempest-CreateVolumesFromImageTest-1090382102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:44 devstack sudo[94067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:03:44 devstack sudo[94067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:44 devstack sudo[94067]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-bdd89e3e-8a0e-42e5-879a-f805b9a15297 tempest-CreateVolumesFromImageTest-1090382102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.434s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:44 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-bdd89e3e-8a0e-42e5-879a-f805b9a15297 tempest-CreateVolumesFromImageTest-1090382102 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:03:44 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-bdd89e3e-8a0e-42e5-879a-f805b9a15297 tempest-CreateVolumesFromImageTest-1090382102 None] Deleted volume successfully.
Nov 19 13:03:45 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-bdd89e3e-8a0e-42e5-879a-f805b9a15297 tempest-CreateVolumesFromImageTest-1090382102 None] Lock "cinder-397f9811-45b8-4f4a-83fd-417fdd2621b1-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:03:47 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:03:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Flow 'volume_create_manager' (62e65f20-3d20-42bc-891f-4f2221e47553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:03:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffe55f8f-730e-4e51-a294-917aa09125a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffe55f8f-730e-4e51-a294-917aa09125a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1048843324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463bf099-7d52-4944-a8b1-aaad35f39710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b79493a9b647d59d811a79afbe1c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:03:47Z,use_quota=True,user_id='dd0f0bcc2bf04c05bcbbbcb8bae68251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece2f254-3dee-44e3-aba2-a93c30eb68a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece2f254-3dee-44e3-aba2-a93c30eb68a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e514dc3e-6952-4ffc-bc95-637a2e769622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e514dc3e-6952-4ffc-bc95-637a2e769622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '463bf099-7d52-4944-a8b1-aaad35f39710', 'volume_name': 'volume-463bf099-7d52-4944-a8b1-aaad35f39710', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (947124bd-7637-4540-bcf1-6a3acb0b6e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (947124bd-7637-4540-bcf1-6a3acb0b6e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271d2935-1386-4826-ac97-b3c85b8dcc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:47 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Volume 463bf099-7d52-4944-a8b1-aaad35f39710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-463bf099-7d52-4944-a8b1-aaad35f39710', 'volume_size': 1}
Nov 19 13:03:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1048843324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463bf099-7d52-4944-a8b1-aaad35f39710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b79493a9b647d59d811a79afbe1c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:03:47Z,use_quota=True,user_id='dd0f0bcc2bf04c05bcbbbcb8bae68251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:03:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Creating volume 463bf099-7d52-4944-a8b1-aaad35f39710 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:03:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:03:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:03:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:03:47 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:03:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-463bf099-7d52-4944-a8b1-aaad35f39710 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:47 devstack sudo[94070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-463bf099-7d52-4944-a8b1-aaad35f39710 1073741824
Nov 19 13:03:47 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:47 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-463bf099-7d52-4944-a8b1-aaad35f39710 1073741824" returned: 0 in 0.544s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-463bf099-7d52-4944-a8b1-aaad35f39710 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:47 devstack sudo[94075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-463bf099-7d52-4944-a8b1-aaad35f39710
Nov 19 13:03:47 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:48 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-463bf099-7d52-4944-a8b1-aaad35f39710" returned: 0 in 0.451s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:48 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:03:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271d2935-1386-4826-ac97-b3c85b8dcc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-463bf099-7d52-4944-a8b1-aaad35f39710', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44571399-1f6a-4345-911e-ec629536417f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:48 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Volume volume-463bf099-7d52-4944-a8b1-aaad35f39710 (463bf099-7d52-4944-a8b1-aaad35f39710): created successfully
Nov 19 13:03:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44571399-1f6a-4345-911e-ec629536417f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Flow 'volume_create_manager' (62e65f20-3d20-42bc-891f-4f2221e47553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:03:48 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-94bf8dab-56da-4f42-bbc0-1d592015470f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Created volume successfully.
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Flow 'volume_create_manager' (6e77b72a-aa1c-469a-8001-6c9f384bc060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77779b7-5125-46f4-8f0d-48ffa025fa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77779b7-5125-46f4-8f0d-48ffa025fa71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-985678167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94b4982-7ce7-43ba-9a46-295fc6acdbb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b79493a9b647d59d811a79afbe1c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:03:49Z,use_quota=True,user_id='dd0f0bcc2bf04c05bcbbbcb8bae68251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a91c71-d700-4d32-bbc9-037cbaab935a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a91c71-d700-4d32-bbc9-037cbaab935a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b17c491e-631a-4865-91ca-9d84508a954c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b17c491e-631a-4865-91ca-9d84508a954c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c94b4982-7ce7-43ba-9a46-295fc6acdbb8', 'volume_name': 'volume-c94b4982-7ce7-43ba-9a46-295fc6acdbb8', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f50df0-f34b-4ad2-9460-42037c2cc338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f50df0-f34b-4ad2-9460-42037c2cc338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5729129c-5321-417f-8ca2-07c2c32deba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:49 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Volume c94b4982-7ce7-43ba-9a46-295fc6acdbb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c94b4982-7ce7-43ba-9a46-295fc6acdbb8', 'volume_size': 1}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-985678167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94b4982-7ce7-43ba-9a46-295fc6acdbb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b79493a9b647d59d811a79afbe1c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:03:49Z,use_quota=True,user_id='dd0f0bcc2bf04c05bcbbbcb8bae68251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Creating volume c94b4982-7ce7-43ba-9a46-295fc6acdbb8 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:03:49 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c94b4982-7ce7-43ba-9a46-295fc6acdbb8 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:49 devstack sudo[94081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c94b4982-7ce7-43ba-9a46-295fc6acdbb8 1073741824
Nov 19 13:03:49 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Flow 'volume_create_manager' (61a2b3af-40f3-41e9-ac23-2d090c1bbb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ee3c25-359b-4509-a1a9-6825176e838c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ee3c25-359b-4509-a1a9-6825176e838c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1536990307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9c442e4-14d4-49f9-9f96-ad6f723b90c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b79493a9b647d59d811a79afbe1c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:03:50Z,use_quota=True,user_id='dd0f0bcc2bf04c05bcbbbcb8bae68251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79a47a5-0407-4d8a-bea2-23953c2013eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79a47a5-0407-4d8a-bea2-23953c2013eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e203cf5-85fc-4e29-a403-dbb5e61331c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e203cf5-85fc-4e29-a403-dbb5e61331c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9c442e4-14d4-49f9-9f96-ad6f723b90c1', 'volume_name': 'volume-c9c442e4-14d4-49f9-9f96-ad6f723b90c1', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7637617f-e381-4606-a238-40d420dabf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7637617f-e381-4606-a238-40d420dabf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2071c6ba-a40a-4631-b87f-5b4cad08f095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:49 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Volume c9c442e4-14d4-49f9-9f96-ad6f723b90c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9c442e4-14d4-49f9-9f96-ad6f723b90c1', 'volume_size': 1}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Flow 'volume_create_manager' (708182c5-23e8-4be9-a872-149401ce6790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8ec5c94-bbd8-46c4-83bc-6f4e0c733598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8ec5c94-bbd8-46c4-83bc-6f4e0c733598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-105243074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=849eca79-c783-4deb-b6cd-b0cce22a0484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b79493a9b647d59d811a79afbe1c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:03:50Z,use_quota=True,user_id='dd0f0bcc2bf04c05bcbbbcb8bae68251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d219367-f3bd-4e0a-a02d-46f886cb24b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d219367-f3bd-4e0a-a02d-46f886cb24b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17987348-85f8-4298-92da-e75dcbb2de8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17987348-85f8-4298-92da-e75dcbb2de8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '849eca79-c783-4deb-b6cd-b0cce22a0484', 'volume_name': 'volume-849eca79-c783-4deb-b6cd-b0cce22a0484', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f4ac5e-8917-4af3-b1c6-a683a7f25130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f4ac5e-8917-4af3-b1c6-a683a7f25130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (377fee8b-fb75-4b17-9aae-22fb881e0a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:49 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Volume 849eca79-c783-4deb-b6cd-b0cce22a0484: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-849eca79-c783-4deb-b6cd-b0cce22a0484', 'volume_size': 1}
Nov 19 13:03:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Flow 'volume_create_manager' (4adc0093-4e53-40e8-9a0d-2037cfe6969b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb435b40-020e-43e9-bcde-d2f6da277424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb435b40-020e-43e9-bcde-d2f6da277424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1142713058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602feb2a-a97b-4f27-b7aa-be2bf7cfe08c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b79493a9b647d59d811a79afbe1c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:03:50Z,use_quota=True,user_id='dd0f0bcc2bf04c05bcbbbcb8bae68251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7325cd7-7582-40d5-a1be-635b2a2e78a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7325cd7-7582-40d5-a1be-635b2a2e78a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82b9f9a-57c8-46d6-99cd-e317cdb45457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82b9f9a-57c8-46d6-99cd-e317cdb45457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '602feb2a-a97b-4f27-b7aa-be2bf7cfe08c', 'volume_name': 'volume-602feb2a-a97b-4f27-b7aa-be2bf7cfe08c', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ce149e-1c6c-4a60-9592-02d7a2fca024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ce149e-1c6c-4a60-9592-02d7a2fca024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a53d678-48d0-4ecd-b819-681e29002cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:50 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Volume 602feb2a-a97b-4f27-b7aa-be2bf7cfe08c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-602feb2a-a97b-4f27-b7aa-be2bf7cfe08c', 'volume_size': 1}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:50 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c94b4982-7ce7-43ba-9a46-295fc6acdbb8 1073741824" returned: 0 in 0.665s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c94b4982-7ce7-43ba-9a46-295fc6acdbb8 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:50 devstack sudo[94089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c94b4982-7ce7-43ba-9a46-295fc6acdbb8
Nov 19 13:03:50 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Flow 'volume_create_manager' (c8813e93-eb2c-4793-8852-df234c2a9864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7802dd3-a31e-4549-bf23-453a46f1dc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7802dd3-a31e-4549-bf23-453a46f1dc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-892882044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce58370-9a6a-4b47-9dea-936839b164d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b79493a9b647d59d811a79afbe1c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:03:50Z,use_quota=True,user_id='dd0f0bcc2bf04c05bcbbbcb8bae68251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b143706-b227-4e8d-9056-4f63e4ae6722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b143706-b227-4e8d-9056-4f63e4ae6722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25647fb6-80a4-4f54-bdeb-0f456ff1f501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25647fb6-80a4-4f54-bdeb-0f456ff1f501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ce58370-9a6a-4b47-9dea-936839b164d2', 'volume_name': 'volume-9ce58370-9a6a-4b47-9dea-936839b164d2', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d3a6b1-0710-45f1-9b3a-05baadfb7fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d3a6b1-0710-45f1-9b3a-05baadfb7fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66247449-8a5e-4f63-bd69-ced28ae330ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:50 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Volume 9ce58370-9a6a-4b47-9dea-936839b164d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ce58370-9a6a-4b47-9dea-936839b164d2', 'volume_size': 1}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:50 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c94b4982-7ce7-43ba-9a46-295fc6acdbb8" returned: 0 in 0.449s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.918s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1536990307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9c442e4-14d4-49f9-9f96-ad6f723b90c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b79493a9b647d59d811a79afbe1c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:03:50Z,use_quota=True,user_id='dd0f0bcc2bf04c05bcbbbcb8bae68251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Creating volume c9c442e4-14d4-49f9-9f96-ad6f723b90c1 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:03:50 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c9c442e4-14d4-49f9-9f96-ad6f723b90c1 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5729129c-5321-417f-8ca2-07c2c32deba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c94b4982-7ce7-43ba-9a46-295fc6acdbb8', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ace5ac-5357-433d-8c67-b8fa4feccc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:50 devstack sudo[94094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c9c442e4-14d4-49f9-9f96-ad6f723b90c1 1073741824
Nov 19 13:03:50 devstack sudo[94094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:50 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Volume volume-c94b4982-7ce7-43ba-9a46-295fc6acdbb8 (c94b4982-7ce7-43ba-9a46-295fc6acdbb8): created successfully
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ace5ac-5357-433d-8c67-b8fa4feccc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Flow 'volume_create_manager' (6e77b72a-aa1c-469a-8001-6c9f384bc060) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:03:50 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-7eb88994-eae3-42e5-9156-c645c02440bb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Created volume successfully.
Nov 19 13:03:51 devstack sudo[94094]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c9c442e4-14d4-49f9-9f96-ad6f723b90c1 1073741824" returned: 0 in 0.549s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c9c442e4-14d4-49f9-9f96-ad6f723b90c1 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:51 devstack sudo[94101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c9c442e4-14d4-49f9-9f96-ad6f723b90c1
Nov 19 13:03:51 devstack sudo[94101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:51 devstack sudo[94101]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c9c442e4-14d4-49f9-9f96-ad6f723b90c1" returned: 0 in 0.445s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:51 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:03:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.720s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:51 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-105243074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=849eca79-c783-4deb-b6cd-b0cce22a0484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b79493a9b647d59d811a79afbe1c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:03:50Z,use_quota=True,user_id='dd0f0bcc2bf04c05bcbbbcb8bae68251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:03:51 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Creating volume 849eca79-c783-4deb-b6cd-b0cce22a0484 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:03:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:51 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:03:51 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:03:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:51 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:03:51 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:03:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-849eca79-c783-4deb-b6cd-b0cce22a0484 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:51 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2071c6ba-a40a-4631-b87f-5b4cad08f095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9c442e4-14d4-49f9-9f96-ad6f723b90c1', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:51 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ffc792b-75e3-4e6b-9476-278f7b11fe6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:51 devstack sudo[94106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-849eca79-c783-4deb-b6cd-b0cce22a0484 1073741824
Nov 19 13:03:51 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:51 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Volume volume-c9c442e4-14d4-49f9-9f96-ad6f723b90c1 (c9c442e4-14d4-49f9-9f96-ad6f723b90c1): created successfully
Nov 19 13:03:51 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ffc792b-75e3-4e6b-9476-278f7b11fe6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:51 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Flow 'volume_create_manager' (61a2b3af-40f3-41e9-ac23-2d090c1bbb32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:03:51 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-a71aacf3-0808-44aa-ac46-f368d90302eb tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Created volume successfully.
Nov 19 13:03:52 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-849eca79-c783-4deb-b6cd-b0cce22a0484 1073741824" returned: 0 in 0.559s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-849eca79-c783-4deb-b6cd-b0cce22a0484 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:52 devstack sudo[94116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-849eca79-c783-4deb-b6cd-b0cce22a0484
Nov 19 13:03:52 devstack sudo[94116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:52 devstack sudo[94116]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-849eca79-c783-4deb-b6cd-b0cce22a0484" returned: 0 in 0.507s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:03:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.617s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1142713058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602feb2a-a97b-4f27-b7aa-be2bf7cfe08c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b79493a9b647d59d811a79afbe1c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:03:50Z,use_quota=True,user_id='dd0f0bcc2bf04c05bcbbbcb8bae68251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:03:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Creating volume 602feb2a-a97b-4f27-b7aa-be2bf7cfe08c {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:03:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:03:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:03:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:03:52 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:03:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-602feb2a-a97b-4f27-b7aa-be2bf7cfe08c 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (377fee8b-fb75-4b17-9aae-22fb881e0a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-849eca79-c783-4deb-b6cd-b0cce22a0484', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b609acd4-b0fd-4c82-affe-6b5fb91fc092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:52 devstack sudo[94124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-602feb2a-a97b-4f27-b7aa-be2bf7cfe08c 1073741824
Nov 19 13:03:52 devstack sudo[94124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:52 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Volume volume-849eca79-c783-4deb-b6cd-b0cce22a0484 (849eca79-c783-4deb-b6cd-b0cce22a0484): created successfully
Nov 19 13:03:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b609acd4-b0fd-4c82-affe-6b5fb91fc092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Flow 'volume_create_manager' (708182c5-23e8-4be9-a872-149401ce6790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:03:52 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-cc25301f-6f1f-4b6a-b9f2-b1022504080f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Created volume successfully.
Nov 19 13:03:53 devstack sudo[94124]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-602feb2a-a97b-4f27-b7aa-be2bf7cfe08c 1073741824" returned: 0 in 0.551s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-602feb2a-a97b-4f27-b7aa-be2bf7cfe08c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:53 devstack sudo[94129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-602feb2a-a97b-4f27-b7aa-be2bf7cfe08c
Nov 19 13:03:53 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:53 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-602feb2a-a97b-4f27-b7aa-be2bf7cfe08c" returned: 0 in 0.472s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:53 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:03:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.421s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:53 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-892882044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce58370-9a6a-4b47-9dea-936839b164d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b79493a9b647d59d811a79afbe1c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:03:50Z,use_quota=True,user_id='dd0f0bcc2bf04c05bcbbbcb8bae68251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:03:53 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Creating volume 9ce58370-9a6a-4b47-9dea-936839b164d2 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:03:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:53 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:03:53 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:03:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:53 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:03:53 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:03:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ce58370-9a6a-4b47-9dea-936839b164d2 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a53d678-48d0-4ecd-b819-681e29002cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-602feb2a-a97b-4f27-b7aa-be2bf7cfe08c', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a171b4c0-509e-4aa6-b409-075327868841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:53 devstack sudo[94132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ce58370-9a6a-4b47-9dea-936839b164d2 1073741824
Nov 19 13:03:53 devstack sudo[94132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:53 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Volume volume-602feb2a-a97b-4f27-b7aa-be2bf7cfe08c (602feb2a-a97b-4f27-b7aa-be2bf7cfe08c): created successfully
Nov 19 13:03:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a171b4c0-509e-4aa6-b409-075327868841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Flow 'volume_create_manager' (4adc0093-4e53-40e8-9a0d-2037cfe6969b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:03:53 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-05e059c3-32a3-4fdd-a3be-dbed8fa9713f tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Created volume successfully.
Nov 19 13:03:54 devstack sudo[94132]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ce58370-9a6a-4b47-9dea-936839b164d2 1073741824" returned: 0 in 0.570s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ce58370-9a6a-4b47-9dea-936839b164d2 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:54 devstack sudo[94137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ce58370-9a6a-4b47-9dea-936839b164d2
Nov 19 13:03:54 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:54 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-edf0d68b-e764-4a29-9e03-f6d80f07b390 req-3e370e93-c294-4747-8685-bc9213885158 tempest-AttachVolumeTestJSON-1179299540 None] Terminate volume connection completed successfully.
Nov 19 13:03:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-edf0d68b-e764-4a29-9e03-f6d80f07b390 req-3e370e93-c294-4747-8685-bc9213885158 tempest-AttachVolumeTestJSON-1179299540 None] Deleting attachment 61f53da7-4afe-454b-8937-570b49bc2be3. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 13:03:54 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ce58370-9a6a-4b47-9dea-936839b164d2" returned: 0 in 0.468s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:54 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:03:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66247449-8a5e-4f63-bd69-ced28ae330ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ce58370-9a6a-4b47-9dea-936839b164d2', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c814262-fb23-41cd-b7e5-cf46dde3f636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:03:54 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Volume volume-9ce58370-9a6a-4b47-9dea-936839b164d2 (9ce58370-9a6a-4b47-9dea-936839b164d2): created successfully
Nov 19 13:03:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c814262-fb23-41cd-b7e5-cf46dde3f636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:03:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Flow 'volume_create_manager' (c8813e93-eb2c-4793-8852-df234c2a9864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:03:54 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-251b2c39-38c7-4e23-9994-1a14344e3aa3 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Created volume successfully.
Nov 19 13:03:55 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-411a8e6f-a6c9-470e-b54b-2a07d7936a22 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "cinder-9ce58370-9a6a-4b47-9dea-936839b164d2-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:03:55 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-411a8e6f-a6c9-470e-b54b-2a07d7936a22 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "cinder-9ce58370-9a6a-4b47-9dea-936839b164d2-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:03:55 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-411a8e6f-a6c9-470e-b54b-2a07d7936a22 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "cinder-quobyte-9ce58370-9a6a-4b47-9dea-936839b164d2" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:03:55 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-411a8e6f-a6c9-470e-b54b-2a07d7936a22 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "cinder-quobyte-9ce58370-9a6a-4b47-9dea-936839b164d2" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:03:55 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b03e82-c050-471b-94f3-cb615a62e7d2]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:03:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-411a8e6f-a6c9-470e-b54b-2a07d7936a22 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ce58370-9a6a-4b47-9dea-936839b164d2 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:55 devstack sudo[94142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ce58370-9a6a-4b47-9dea-936839b164d2
Nov 19 13:03:55 devstack sudo[94142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:56 devstack sudo[94142]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-411a8e6f-a6c9-470e-b54b-2a07d7936a22 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ce58370-9a6a-4b47-9dea-936839b164d2" returned: 0 in 0.587s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-411a8e6f-a6c9-470e-b54b-2a07d7936a22 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ce58370-9a6a-4b47-9dea-936839b164d2 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:56 devstack sudo[94147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ce58370-9a6a-4b47-9dea-936839b164d2
Nov 19 13:03:56 devstack sudo[94147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:56 devstack sudo[94147]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-411a8e6f-a6c9-470e-b54b-2a07d7936a22 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-9ce58370-9a6a-4b47-9dea-936839b164d2" returned: 0 in 0.462s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:56 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-411a8e6f-a6c9-470e-b54b-2a07d7936a22 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "cinder-quobyte-9ce58370-9a6a-4b47-9dea-936839b164d2" released by "delete_volume" :: held 1.080s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:03:56 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-411a8e6f-a6c9-470e-b54b-2a07d7936a22 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Created reservations ['09bdc146-f70f-4f1e-84ad-f64d2f3f060f', 'f4b0dd22-4a4e-48be-a1f8-7cfe2e89f620', '25917912-278e-48a6-b634-2c62640b4ff7', 'f1e6d658-1a08-499f-88a0-bbe2b2c9a32d'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:03:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-411a8e6f-a6c9-470e-b54b-2a07d7936a22 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-411a8e6f-a6c9-470e-b54b-2a07d7936a22 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:57 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-411a8e6f-a6c9-470e-b54b-2a07d7936a22 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:03:57 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-411a8e6f-a6c9-470e-b54b-2a07d7936a22 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:03:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-411a8e6f-a6c9-470e-b54b-2a07d7936a22 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-411a8e6f-a6c9-470e-b54b-2a07d7936a22 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:57 devstack sudo[94150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:03:57 devstack sudo[94150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:57 devstack sudo[94150]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-411a8e6f-a6c9-470e-b54b-2a07d7936a22 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.464s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:57 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-411a8e6f-a6c9-470e-b54b-2a07d7936a22 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:03:57 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-411a8e6f-a6c9-470e-b54b-2a07d7936a22 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Deleted volume successfully.
Nov 19 13:03:57 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-411a8e6f-a6c9-470e-b54b-2a07d7936a22 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "cinder-9ce58370-9a6a-4b47-9dea-936839b164d2-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:03:58 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-4a897c88-6ae6-4ee3-9856-86a1175fd0f7 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "cinder-602feb2a-a97b-4f27-b7aa-be2bf7cfe08c-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:03:58 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-4a897c88-6ae6-4ee3-9856-86a1175fd0f7 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "cinder-602feb2a-a97b-4f27-b7aa-be2bf7cfe08c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:03:58 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-4a897c88-6ae6-4ee3-9856-86a1175fd0f7 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "cinder-quobyte-602feb2a-a97b-4f27-b7aa-be2bf7cfe08c" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:03:58 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-4a897c88-6ae6-4ee3-9856-86a1175fd0f7 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "cinder-quobyte-602feb2a-a97b-4f27-b7aa-be2bf7cfe08c" acquired by "delete_volume" :: waited 0.025s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:03:58 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83f61f0-c11c-4a44-9c8c-b30f5de3e0f6]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:03:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4a897c88-6ae6-4ee3-9856-86a1175fd0f7 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-602feb2a-a97b-4f27-b7aa-be2bf7cfe08c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:58 devstack sudo[94188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-602feb2a-a97b-4f27-b7aa-be2bf7cfe08c
Nov 19 13:03:58 devstack sudo[94188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:58 devstack sudo[94188]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4a897c88-6ae6-4ee3-9856-86a1175fd0f7 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-602feb2a-a97b-4f27-b7aa-be2bf7cfe08c" returned: 0 in 0.613s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4a897c88-6ae6-4ee3-9856-86a1175fd0f7 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-602feb2a-a97b-4f27-b7aa-be2bf7cfe08c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:58 devstack sudo[94193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-602feb2a-a97b-4f27-b7aa-be2bf7cfe08c
Nov 19 13:03:58 devstack sudo[94193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:59 devstack sudo[94193]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4a897c88-6ae6-4ee3-9856-86a1175fd0f7 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-602feb2a-a97b-4f27-b7aa-be2bf7cfe08c" returned: 0 in 0.501s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:59 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-4a897c88-6ae6-4ee3-9856-86a1175fd0f7 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "cinder-quobyte-602feb2a-a97b-4f27-b7aa-be2bf7cfe08c" released by "delete_volume" :: held 1.133s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:03:59 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-4a897c88-6ae6-4ee3-9856-86a1175fd0f7 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Created reservations ['0c412617-5974-42e4-9c9e-8f654b00e6a8', 'ecd861ae-e87f-445a-bdd3-7e3fcaba337d', '5c8fae9f-3f0f-4bd1-86fa-8e2133e72a4b', '976818b5-a696-4dbb-81aa-573409b1f5ff'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:03:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4a897c88-6ae6-4ee3-9856-86a1175fd0f7 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:03:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4a897c88-6ae6-4ee3-9856-86a1175fd0f7 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:03:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4a897c88-6ae6-4ee3-9856-86a1175fd0f7 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:03:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4a897c88-6ae6-4ee3-9856-86a1175fd0f7 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:03:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4a897c88-6ae6-4ee3-9856-86a1175fd0f7 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:03:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4a897c88-6ae6-4ee3-9856-86a1175fd0f7 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:03:59 devstack sudo[94196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:03:59 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:03:59 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root
Nov 19 13:03:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4a897c88-6ae6-4ee3-9856-86a1175fd0f7 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.471s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:03:59 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-4a897c88-6ae6-4ee3-9856-86a1175fd0f7 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:03:59 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-4a897c88-6ae6-4ee3-9856-86a1175fd0f7 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Deleted volume successfully.
Nov 19 13:03:59 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-4a897c88-6ae6-4ee3-9856-86a1175fd0f7 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "cinder-602feb2a-a97b-4f27-b7aa-be2bf7cfe08c-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:04:00 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-ceb22707-3de9-4d60-a820-3f25925002f2 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "cinder-849eca79-c783-4deb-b6cd-b0cce22a0484-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:04:00 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-ceb22707-3de9-4d60-a820-3f25925002f2 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "cinder-849eca79-c783-4deb-b6cd-b0cce22a0484-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:04:00 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-ceb22707-3de9-4d60-a820-3f25925002f2 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "cinder-quobyte-849eca79-c783-4deb-b6cd-b0cce22a0484" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:04:00 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-ceb22707-3de9-4d60-a820-3f25925002f2 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "cinder-quobyte-849eca79-c783-4deb-b6cd-b0cce22a0484" acquired by "delete_volume" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:04:00 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d6553b-6b21-4cf5-aa78-1378b2c67c8e]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:04:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ceb22707-3de9-4d60-a820-3f25925002f2 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-849eca79-c783-4deb-b6cd-b0cce22a0484 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:00 devstack sudo[94199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-849eca79-c783-4deb-b6cd-b0cce22a0484
Nov 19 13:04:00 devstack sudo[94199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:00 devstack sudo[94199]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ceb22707-3de9-4d60-a820-3f25925002f2 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-849eca79-c783-4deb-b6cd-b0cce22a0484" returned: 0 in 0.569s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ceb22707-3de9-4d60-a820-3f25925002f2 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-849eca79-c783-4deb-b6cd-b0cce22a0484 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:00 devstack sudo[94204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-849eca79-c783-4deb-b6cd-b0cce22a0484
Nov 19 13:04:00 devstack sudo[94204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:01 devstack sudo[94204]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ceb22707-3de9-4d60-a820-3f25925002f2 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-849eca79-c783-4deb-b6cd-b0cce22a0484" returned: 0 in 0.522s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-ceb22707-3de9-4d60-a820-3f25925002f2 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "cinder-quobyte-849eca79-c783-4deb-b6cd-b0cce22a0484" released by "delete_volume" :: held 1.116s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:04:01 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-ceb22707-3de9-4d60-a820-3f25925002f2 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Created reservations ['028a5568-63ab-4da6-ab40-13145514d102', '242a6159-cb80-4447-96d2-f40031ec8b62', '486363d4-c2b0-41d7-968e-a8d55cb63599', '79280e5d-72b5-4ffa-aa23-439e67c5d5e7'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:04:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ceb22707-3de9-4d60-a820-3f25925002f2 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:04:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ceb22707-3de9-4d60-a820-3f25925002f2 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:04:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ceb22707-3de9-4d60-a820-3f25925002f2 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:04:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ceb22707-3de9-4d60-a820-3f25925002f2 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:04:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ceb22707-3de9-4d60-a820-3f25925002f2 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:04:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ceb22707-3de9-4d60-a820-3f25925002f2 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:01 devstack sudo[94209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:04:01 devstack sudo[94209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:01 devstack sudo[94209]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ceb22707-3de9-4d60-a820-3f25925002f2 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.469s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:01 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-ceb22707-3de9-4d60-a820-3f25925002f2 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:04:01 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-ceb22707-3de9-4d60-a820-3f25925002f2 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Deleted volume successfully.
Nov 19 13:04:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-ceb22707-3de9-4d60-a820-3f25925002f2 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "cinder-849eca79-c783-4deb-b6cd-b0cce22a0484-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:04:02 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d6373aea-6598-47c7-a1f4-91e22299b804 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "cinder-c9c442e4-14d4-49f9-9f96-ad6f723b90c1-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:04:02 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d6373aea-6598-47c7-a1f4-91e22299b804 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "cinder-c9c442e4-14d4-49f9-9f96-ad6f723b90c1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:04:02 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d6373aea-6598-47c7-a1f4-91e22299b804 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "cinder-quobyte-c9c442e4-14d4-49f9-9f96-ad6f723b90c1" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:04:02 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d6373aea-6598-47c7-a1f4-91e22299b804 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "cinder-quobyte-c9c442e4-14d4-49f9-9f96-ad6f723b90c1" acquired by "delete_volume" :: waited 0.014s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:04:02 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1049d5-64f4-4ac1-80d9-8476a80f1277]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:04:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d6373aea-6598-47c7-a1f4-91e22299b804 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c9c442e4-14d4-49f9-9f96-ad6f723b90c1 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:02 devstack sudo[94215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c9c442e4-14d4-49f9-9f96-ad6f723b90c1
Nov 19 13:04:02 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:03 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d6373aea-6598-47c7-a1f4-91e22299b804 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c9c442e4-14d4-49f9-9f96-ad6f723b90c1" returned: 0 in 0.658s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d6373aea-6598-47c7-a1f4-91e22299b804 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c9c442e4-14d4-49f9-9f96-ad6f723b90c1 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:03 devstack sudo[94221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c9c442e4-14d4-49f9-9f96-ad6f723b90c1
Nov 19 13:04:03 devstack sudo[94221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:03 devstack sudo[94221]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d6373aea-6598-47c7-a1f4-91e22299b804 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c9c442e4-14d4-49f9-9f96-ad6f723b90c1" returned: 0 in 0.453s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:03 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d6373aea-6598-47c7-a1f4-91e22299b804 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "cinder-quobyte-c9c442e4-14d4-49f9-9f96-ad6f723b90c1" released by "delete_volume" :: held 1.188s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:04:03 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-d6373aea-6598-47c7-a1f4-91e22299b804 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Created reservations ['0cdad4d4-02ce-4e5d-8fc0-f27af186a81c', '4ee405fe-4f16-412e-98cc-a1fa067068d4', '03775b90-6704-425f-b947-117c7d10d163', '0164bd2e-eabc-4ff9-b33c-ced854644842'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:04:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d6373aea-6598-47c7-a1f4-91e22299b804 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:04:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d6373aea-6598-47c7-a1f4-91e22299b804 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:04:03 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d6373aea-6598-47c7-a1f4-91e22299b804 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:04:03 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d6373aea-6598-47c7-a1f4-91e22299b804 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:04:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d6373aea-6598-47c7-a1f4-91e22299b804 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:04:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d6373aea-6598-47c7-a1f4-91e22299b804 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:03 devstack sudo[94224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:04:03 devstack sudo[94224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:04 devstack sudo[94224]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d6373aea-6598-47c7-a1f4-91e22299b804 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.545s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:04 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-d6373aea-6598-47c7-a1f4-91e22299b804 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:04:04 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-d6373aea-6598-47c7-a1f4-91e22299b804 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Deleted volume successfully.
Nov 19 13:04:04 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d6373aea-6598-47c7-a1f4-91e22299b804 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "cinder-c9c442e4-14d4-49f9-9f96-ad6f723b90c1-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:04:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 13:04:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:04:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:04:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:04:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:04:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:04:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:04 devstack sudo[94262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:04:04 devstack sudo[94262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:04 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b7eaca3c-563f-4a59-8677-fe3a24aa3944 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "cinder-c94b4982-7ce7-43ba-9a46-295fc6acdbb8-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:04:04 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b7eaca3c-563f-4a59-8677-fe3a24aa3944 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "cinder-c94b4982-7ce7-43ba-9a46-295fc6acdbb8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:04:04 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b7eaca3c-563f-4a59-8677-fe3a24aa3944 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "cinder-quobyte-c94b4982-7ce7-43ba-9a46-295fc6acdbb8" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:04:04 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b7eaca3c-563f-4a59-8677-fe3a24aa3944 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "cinder-quobyte-c94b4982-7ce7-43ba-9a46-295fc6acdbb8" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:04:04 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b7f287-f118-4385-bb65-bef8b1a4896c]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:04:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b7eaca3c-563f-4a59-8677-fe3a24aa3944 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c94b4982-7ce7-43ba-9a46-295fc6acdbb8 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:04 devstack sudo[94265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c94b4982-7ce7-43ba-9a46-295fc6acdbb8
Nov 19 13:04:04 devstack sudo[94265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:04 devstack sudo[94262]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.471s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:04 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:04:05 devstack sudo[94265]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b7eaca3c-563f-4a59-8677-fe3a24aa3944 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c94b4982-7ce7-43ba-9a46-295fc6acdbb8" returned: 0 in 0.593s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b7eaca3c-563f-4a59-8677-fe3a24aa3944 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c94b4982-7ce7-43ba-9a46-295fc6acdbb8 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:05 devstack sudo[94276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c94b4982-7ce7-43ba-9a46-295fc6acdbb8
Nov 19 13:04:05 devstack sudo[94276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:05 devstack sudo[94276]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b7eaca3c-563f-4a59-8677-fe3a24aa3944 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c94b4982-7ce7-43ba-9a46-295fc6acdbb8" returned: 0 in 0.484s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:05 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b7eaca3c-563f-4a59-8677-fe3a24aa3944 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "cinder-quobyte-c94b4982-7ce7-43ba-9a46-295fc6acdbb8" released by "delete_volume" :: held 1.109s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:04:05 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-b7eaca3c-563f-4a59-8677-fe3a24aa3944 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Created reservations ['ae082e0d-3e2f-4227-9c2f-b1783ff62ad1', '53ec0434-0857-408f-b89f-7d9be2b4978b', '1829532c-7267-4254-bd9c-1fc6612567dc', 'd8e9cd10-fd34-46b7-bb66-bcca1c1eec86'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:04:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b7eaca3c-563f-4a59-8677-fe3a24aa3944 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:04:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b7eaca3c-563f-4a59-8677-fe3a24aa3944 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:04:05 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b7eaca3c-563f-4a59-8677-fe3a24aa3944 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:04:05 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b7eaca3c-563f-4a59-8677-fe3a24aa3944 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:04:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b7eaca3c-563f-4a59-8677-fe3a24aa3944 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:04:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b7eaca3c-563f-4a59-8677-fe3a24aa3944 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:05 devstack sudo[94287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:04:05 devstack sudo[94287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:06 devstack sudo[94287]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b7eaca3c-563f-4a59-8677-fe3a24aa3944 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.531s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:06 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-b7eaca3c-563f-4a59-8677-fe3a24aa3944 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:04:06 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-b7eaca3c-563f-4a59-8677-fe3a24aa3944 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Deleted volume successfully.
Nov 19 13:04:06 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b7eaca3c-563f-4a59-8677-fe3a24aa3944 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "cinder-c94b4982-7ce7-43ba-9a46-295fc6acdbb8-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:04:06 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-e427cef8-84f0-4b42-bcfd-266b6517f802 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "cinder-463bf099-7d52-4944-a8b1-aaad35f39710-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:04:06 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-e427cef8-84f0-4b42-bcfd-266b6517f802 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "cinder-463bf099-7d52-4944-a8b1-aaad35f39710-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:04:07 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-e427cef8-84f0-4b42-bcfd-266b6517f802 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "cinder-quobyte-463bf099-7d52-4944-a8b1-aaad35f39710" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:04:07 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-e427cef8-84f0-4b42-bcfd-266b6517f802 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "cinder-quobyte-463bf099-7d52-4944-a8b1-aaad35f39710" acquired by "delete_volume" :: waited 0.019s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:04:07 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3b0844-4114-40f6-8abc-ef3cb2de2618]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:04:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e427cef8-84f0-4b42-bcfd-266b6517f802 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-463bf099-7d52-4944-a8b1-aaad35f39710 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:07 devstack sudo[94349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-463bf099-7d52-4944-a8b1-aaad35f39710
Nov 19 13:04:07 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:07 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e427cef8-84f0-4b42-bcfd-266b6517f802 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-463bf099-7d52-4944-a8b1-aaad35f39710" returned: 0 in 0.632s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e427cef8-84f0-4b42-bcfd-266b6517f802 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-463bf099-7d52-4944-a8b1-aaad35f39710 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:07 devstack sudo[94354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-463bf099-7d52-4944-a8b1-aaad35f39710
Nov 19 13:04:07 devstack sudo[94354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:08 devstack sudo[94354]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e427cef8-84f0-4b42-bcfd-266b6517f802 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-463bf099-7d52-4944-a8b1-aaad35f39710" returned: 0 in 0.646s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:08 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-e427cef8-84f0-4b42-bcfd-266b6517f802 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "cinder-quobyte-463bf099-7d52-4944-a8b1-aaad35f39710" released by "delete_volume" :: held 1.330s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:04:08 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-e427cef8-84f0-4b42-bcfd-266b6517f802 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Created reservations ['ea25018b-6897-418a-b0af-0a811c1a2e97', '46c1cbbb-e95f-41f8-9e49-e20921ea50b7', 'f9de1e51-6b9f-47cc-bcc0-5a70eb74c047', 'b8912db2-7150-4a40-80c1-b4e83cea6159'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:04:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e427cef8-84f0-4b42-bcfd-266b6517f802 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:04:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e427cef8-84f0-4b42-bcfd-266b6517f802 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:04:08 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e427cef8-84f0-4b42-bcfd-266b6517f802 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:04:08 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e427cef8-84f0-4b42-bcfd-266b6517f802 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:04:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e427cef8-84f0-4b42-bcfd-266b6517f802 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:04:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e427cef8-84f0-4b42-bcfd-266b6517f802 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:08 devstack sudo[94406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:04:08 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:09 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e427cef8-84f0-4b42-bcfd-266b6517f802 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 1.194s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:09 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-e427cef8-84f0-4b42-bcfd-266b6517f802 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:04:09 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-e427cef8-84f0-4b42-bcfd-266b6517f802 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Deleted volume successfully.
Nov 19 13:04:09 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-e427cef8-84f0-4b42-bcfd-266b6517f802 tempest-CreateVolumesFromSourceVolumeTest-1208486724 None] Lock "cinder-463bf099-7d52-4944-a8b1-aaad35f39710-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:04:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-16b4d546-4b36-4b54-a61f-3827898f0d9b tempest-AttachVolumeShelveTestJSON-1725620549 None] Acquiring lock "cinder-eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:04:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-16b4d546-4b36-4b54-a61f-3827898f0d9b tempest-AttachVolumeShelveTestJSON-1725620549 None] Lock "cinder-eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:04:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-16b4d546-4b36-4b54-a61f-3827898f0d9b tempest-AttachVolumeShelveTestJSON-1725620549 None] Acquiring lock "cinder-quobyte-eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:04:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-16b4d546-4b36-4b54-a61f-3827898f0d9b tempest-AttachVolumeShelveTestJSON-1725620549 None] Lock "cinder-quobyte-eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37" acquired by "delete_volume" :: waited 0.050s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:04:10 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[567d8e21-dc66-41fb-8aa4-e7bff2de388c]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:04:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-16b4d546-4b36-4b54-a61f-3827898f0d9b tempest-AttachVolumeShelveTestJSON-1725620549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:10 devstack sudo[94446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37
Nov 19 13:04:10 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:11 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-16b4d546-4b36-4b54-a61f-3827898f0d9b tempest-AttachVolumeShelveTestJSON-1725620549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37" returned: 0 in 0.702s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-16b4d546-4b36-4b54-a61f-3827898f0d9b tempest-AttachVolumeShelveTestJSON-1725620549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:11 devstack sudo[94451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37
Nov 19 13:04:11 devstack sudo[94451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:11 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:04:11 devstack sudo[94451]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Flow 'volume_create_manager' (5fed95cb-0cbf-43f9-bc97-ed98d23086b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:04:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f4f6dc-65e0-49ac-a3dd-38a57aab757c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-16b4d546-4b36-4b54-a61f-3827898f0d9b tempest-AttachVolumeShelveTestJSON-1725620549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37" returned: 0 in 0.646s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f4f6dc-65e0-49ac-a3dd-38a57aab757c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-14582585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc526cf8-f758-4c36-aa5c-6a8c11150f25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebb0f49fc2f434da09f0c4e9f4b3f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:04:12Z,use_quota=True,user_id='09c4f460f0f44d5d8262d84cbedee1c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092fe5f6-3973-45ef-ab3c-e032ac434141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092fe5f6-3973-45ef-ab3c-e032ac434141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b15a47f-746b-4bf2-a3ab-79fec9570d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b15a47f-746b-4bf2-a3ab-79fec9570d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc526cf8-f758-4c36-aa5c-6a8c11150f25', 'volume_name': 'volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a9123d1-6f2c-40ac-a512-4de2d76644ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a9123d1-6f2c-40ac-a512-4de2d76644ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b73a4043-ebc7-495f-ac04-f68c9fc03a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:11 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Volume cc526cf8-f758-4c36-aa5c-6a8c11150f25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25', 'volume_size': 1}
Nov 19 13:04:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:04:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-14582585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc526cf8-f758-4c36-aa5c-6a8c11150f25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebb0f49fc2f434da09f0c4e9f4b3f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:04:12Z,use_quota=True,user_id='09c4f460f0f44d5d8262d84cbedee1c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Creating volume cc526cf8-f758-4c36-aa5c-6a8c11150f25 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:04:12 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-16b4d546-4b36-4b54-a61f-3827898f0d9b tempest-AttachVolumeShelveTestJSON-1725620549 None] Lock "cinder-quobyte-eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37" released by "delete_volume" :: held 1.496s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:04:12 devstack sudo[94454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25 1073741824
Nov 19 13:04:12 devstack sudo[94454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-16b4d546-4b36-4b54-a61f-3827898f0d9b tempest-AttachVolumeShelveTestJSON-1725620549 None] Created reservations ['b6ed89f7-9b77-4e49-b181-7cbdfd132af8', '5d393f82-6a78-4e5e-bacf-9f1d17fc8444', 'c0bebc56-c104-4d4b-8ab5-aa94d6ababdd', 'afdd5747-0ad7-4778-a3c6-408d78910370'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-16b4d546-4b36-4b54-a61f-3827898f0d9b tempest-AttachVolumeShelveTestJSON-1725620549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-16b4d546-4b36-4b54-a61f-3827898f0d9b tempest-AttachVolumeShelveTestJSON-1725620549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-16b4d546-4b36-4b54-a61f-3827898f0d9b tempest-AttachVolumeShelveTestJSON-1725620549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-16b4d546-4b36-4b54-a61f-3827898f0d9b tempest-AttachVolumeShelveTestJSON-1725620549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-16b4d546-4b36-4b54-a61f-3827898f0d9b tempest-AttachVolumeShelveTestJSON-1725620549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-16b4d546-4b36-4b54-a61f-3827898f0d9b tempest-AttachVolumeShelveTestJSON-1725620549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:12 devstack sudo[94456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:04:12 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:12 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-16b4d546-4b36-4b54-a61f-3827898f0d9b tempest-AttachVolumeShelveTestJSON-1725620549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.464s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-16b4d546-4b36-4b54-a61f-3827898f0d9b tempest-AttachVolumeShelveTestJSON-1725620549 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:04:12 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-16b4d546-4b36-4b54-a61f-3827898f0d9b tempest-AttachVolumeShelveTestJSON-1725620549 None] Deleted volume successfully.
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-16b4d546-4b36-4b54-a61f-3827898f0d9b tempest-AttachVolumeShelveTestJSON-1725620549 None] Lock "cinder-eef0a5c3-1cc2-44fe-8f35-17d4f7a16f37-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:04:12 devstack sudo[94454]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25 1073741824" returned: 0 in 0.671s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:12 devstack sudo[94463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25
Nov 19 13:04:12 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-06691851-d98c-4fcd-b382-d5de2243736a tempest-AttachVolumeShelveTestJSON-1725620549 None] Acquiring lock "cinder-7e2321bf-4965-464a-86bc-2ef7696e40e7-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-06691851-d98c-4fcd-b382-d5de2243736a tempest-AttachVolumeShelveTestJSON-1725620549 None] Lock "cinder-7e2321bf-4965-464a-86bc-2ef7696e40e7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-06691851-d98c-4fcd-b382-d5de2243736a tempest-AttachVolumeShelveTestJSON-1725620549 None] Acquiring lock "cinder-quobyte-7e2321bf-4965-464a-86bc-2ef7696e40e7" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-06691851-d98c-4fcd-b382-d5de2243736a tempest-AttachVolumeShelveTestJSON-1725620549 None] Lock "cinder-quobyte-7e2321bf-4965-464a-86bc-2ef7696e40e7" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2688b1b-9b8f-4cca-a03e-0d8117d59e1a]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:04:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-06691851-d98c-4fcd-b382-d5de2243736a tempest-AttachVolumeShelveTestJSON-1725620549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7e2321bf-4965-464a-86bc-2ef7696e40e7 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:13 devstack sudo[94465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7e2321bf-4965-464a-86bc-2ef7696e40e7
Nov 19 13:04:13 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:13 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25" returned: 0 in 0.539s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:13 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:04:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:04:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b73a4043-ebc7-495f-ac04-f68c9fc03a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (054fcae3-350c-47eb-bb45-df1d0b4a816b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:13 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Volume volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25 (cc526cf8-f758-4c36-aa5c-6a8c11150f25): created successfully
Nov 19 13:04:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (054fcae3-350c-47eb-bb45-df1d0b4a816b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Flow 'volume_create_manager' (5fed95cb-0cbf-43f9-bc97-ed98d23086b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:04:13 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-ca736a5d-474c-4971-aa60-cd8992f4df04 tempest-VolumeDependencyTests-795960316 None] Created volume successfully.
Nov 19 13:04:13 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-06691851-d98c-4fcd-b382-d5de2243736a tempest-AttachVolumeShelveTestJSON-1725620549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7e2321bf-4965-464a-86bc-2ef7696e40e7" returned: 0 in 0.585s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-06691851-d98c-4fcd-b382-d5de2243736a tempest-AttachVolumeShelveTestJSON-1725620549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7e2321bf-4965-464a-86bc-2ef7696e40e7 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:13 devstack sudo[94471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7e2321bf-4965-464a-86bc-2ef7696e40e7
Nov 19 13:04:13 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:13 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-06691851-d98c-4fcd-b382-d5de2243736a tempest-AttachVolumeShelveTestJSON-1725620549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7e2321bf-4965-464a-86bc-2ef7696e40e7" returned: 0 in 0.468s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:13 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-06691851-d98c-4fcd-b382-d5de2243736a tempest-AttachVolumeShelveTestJSON-1725620549 None] Lock "cinder-quobyte-7e2321bf-4965-464a-86bc-2ef7696e40e7" released by "delete_volume" :: held 1.113s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:04:14 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-06691851-d98c-4fcd-b382-d5de2243736a tempest-AttachVolumeShelveTestJSON-1725620549 None] Created reservations ['e1cc4442-277e-4d6c-9d85-b84ed46855e8', 'b4cce381-f69a-42ba-8803-b0e7a758f17a', '0397806d-a58a-4d5a-a1ca-4604b02e8427', 'e6ad45c5-2e22-43d4-b2ee-1766fabc790e'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:04:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-06691851-d98c-4fcd-b382-d5de2243736a tempest-AttachVolumeShelveTestJSON-1725620549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:04:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-06691851-d98c-4fcd-b382-d5de2243736a tempest-AttachVolumeShelveTestJSON-1725620549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:04:14 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-06691851-d98c-4fcd-b382-d5de2243736a tempest-AttachVolumeShelveTestJSON-1725620549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:04:14 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-06691851-d98c-4fcd-b382-d5de2243736a tempest-AttachVolumeShelveTestJSON-1725620549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:04:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-06691851-d98c-4fcd-b382-d5de2243736a tempest-AttachVolumeShelveTestJSON-1725620549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:04:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-06691851-d98c-4fcd-b382-d5de2243736a tempest-AttachVolumeShelveTestJSON-1725620549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:14 devstack sudo[94474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:04:14 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-36c0bd3b-c9dd-4552-95b2-334f26f7f0fc tempest-VolumeDependencyTests-795960316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:04:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-36c0bd3b-c9dd-4552-95b2-334f26f7f0fc tempest-VolumeDependencyTests-795960316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:04:14 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-36c0bd3b-c9dd-4552-95b2-334f26f7f0fc tempest-VolumeDependencyTests-795960316 None] Creating offline snapshot 5812164c-d345-4fb4-88d2-28f25c2fe3a6 of volume cc526cf8-f758-4c36-aa5c-6a8c11150f25 {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 13:04:14 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f493832-43b6-4e51-bab3-8771c160a99a]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:04:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-36c0bd3b-c9dd-4552-95b2-334f26f7f0fc tempest-VolumeDependencyTests-795960316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:14 devstack sudo[94476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25
Nov 19 13:04:14 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:14 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-06691851-d98c-4fcd-b382-d5de2243736a tempest-AttachVolumeShelveTestJSON-1725620549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.496s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:14 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-06691851-d98c-4fcd-b382-d5de2243736a tempest-AttachVolumeShelveTestJSON-1725620549 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:04:14 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-06691851-d98c-4fcd-b382-d5de2243736a tempest-AttachVolumeShelveTestJSON-1725620549 None] Deleted volume successfully.
Nov 19 13:04:14 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-06691851-d98c-4fcd-b382-d5de2243736a tempest-AttachVolumeShelveTestJSON-1725620549 None] Lock "cinder-7e2321bf-4965-464a-86bc-2ef7696e40e7-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:04:14 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-36c0bd3b-c9dd-4552-95b2-334f26f7f0fc tempest-VolumeDependencyTests-795960316 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25" returned: 0 in 0.577s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-36c0bd3b-c9dd-4552-95b2-334f26f7f0fc tempest-VolumeDependencyTests-795960316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.5812164c-d345-4fb4-88d2-28f25c2fe3a6 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:14 devstack sudo[94482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.5812164c-d345-4fb4-88d2-28f25c2fe3a6 1G
Nov 19 13:04:14 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:15 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-36c0bd3b-c9dd-4552-95b2-334f26f7f0fc tempest-VolumeDependencyTests-795960316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.5812164c-d345-4fb4-88d2-28f25c2fe3a6 1G" returned: 0 in 0.591s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-36c0bd3b-c9dd-4552-95b2-334f26f7f0fc tempest-VolumeDependencyTests-795960316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.5812164c-d345-4fb4-88d2-28f25c2fe3a6 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:15 devstack sudo[94487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.5812164c-d345-4fb4-88d2-28f25c2fe3a6
Nov 19 13:04:15 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:15 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-36c0bd3b-c9dd-4552-95b2-334f26f7f0fc tempest-VolumeDependencyTests-795960316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.5812164c-d345-4fb4-88d2-28f25c2fe3a6" returned: 0 in 0.612s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:15 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-36c0bd3b-c9dd-4552-95b2-334f26f7f0fc tempest-VolumeDependencyTests-795960316 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.5812164c-d345-4fb4-88d2-28f25c2fe3a6 is being set with open permissions: ugo+rw
Nov 19 13:04:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-36c0bd3b-c9dd-4552-95b2-334f26f7f0fc tempest-VolumeDependencyTests-795960316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.5812164c-d345-4fb4-88d2-28f25c2fe3a6 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:16 devstack sudo[94492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.5812164c-d345-4fb4-88d2-28f25c2fe3a6
Nov 19 13:04:16 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:16 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-36c0bd3b-c9dd-4552-95b2-334f26f7f0fc tempest-VolumeDependencyTests-795960316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.5812164c-d345-4fb4-88d2-28f25c2fe3a6" returned: 0 in 0.551s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-36c0bd3b-c9dd-4552-95b2-334f26f7f0fc tempest-VolumeDependencyTests-795960316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:16 devstack sudo[94496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.info
Nov 19 13:04:16 devstack sudo[94496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:17 devstack sudo[94496]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-36c0bd3b-c9dd-4552-95b2-334f26f7f0fc tempest-VolumeDependencyTests-795960316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.info" returned: 0 in 0.585s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:17 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-36c0bd3b-c9dd-4552-95b2-334f26f7f0fc tempest-VolumeDependencyTests-795960316 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.info is being set with open permissions: ugo+rw
Nov 19 13:04:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-36c0bd3b-c9dd-4552-95b2-334f26f7f0fc tempest-VolumeDependencyTests-795960316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:17 devstack sudo[94499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.info
Nov 19 13:04:17 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:17 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-36c0bd3b-c9dd-4552-95b2-334f26f7f0fc tempest-VolumeDependencyTests-795960316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.info" returned: 0 in 0.528s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-36c0bd3b-c9dd-4552-95b2-334f26f7f0fc tempest-VolumeDependencyTests-795960316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.490s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:04:17 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-36c0bd3b-c9dd-4552-95b2-334f26f7f0fc tempest-VolumeDependencyTests-795960316 None] Create snapshot completed successfully
Nov 19 13:04:18 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:04:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Flow 'volume_create_manager' (1bcc0742-1805-49d9-a3fa-684f04b4f4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:04:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf065a0-0e75-46ba-bf0d-212e5699e24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf065a0-0e75-46ba-bf0d-212e5699e24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-761412905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5058e817-6155-438e-8cd5-87ecf2e7cf2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebb0f49fc2f434da09f0c4e9f4b3f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5812164c-d345-4fb4-88d2-28f25c2fe3a6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:04:19Z,use_quota=True,user_id='09c4f460f0f44d5d8262d84cbedee1c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b07fde-b019-4a4d-98d2-5542eabd2649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b07fde-b019-4a4d-98d2-5542eabd2649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbe503ce-03ec-4d4c-ab2d-ab138e507281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbe503ce-03ec-4d4c-ab2d-ab138e507281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5058e817-6155-438e-8cd5-87ecf2e7cf2e', 'volume_name': 'volume-5058e817-6155-438e-8cd5-87ecf2e7cf2e', 'volume_size': 1, 'snapshot_id': '5812164c-d345-4fb4-88d2-28f25c2fe3a6'}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c6c5b1-da33-41f7-bfe7-160c05664b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c6c5b1-da33-41f7-bfe7-160c05664b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (745f7670-9eae-453e-9e3e-9c2713198e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:18 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Volume 5058e817-6155-438e-8cd5-87ecf2e7cf2e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5058e817-6155-438e-8cd5-87ecf2e7cf2e', 'volume_size': 1, 'snapshot_id': '5812164c-d345-4fb4-88d2-28f25c2fe3a6'}
Nov 19 13:04:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:04:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:04:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Acquiring lock "cinder-quobyte-5812164c-d345-4fb4-88d2-28f25c2fe3a6-5058e817-6155-438e-8cd5-87ecf2e7cf2e" by "_create_volume_from_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:04:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Lock "cinder-quobyte-5812164c-d345-4fb4-88d2-28f25c2fe3a6-5058e817-6155-438e-8cd5-87ecf2e7cf2e" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:04:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Creating volume 5058e817-6155-438e-8cd5-87ecf2e7cf2e from snapshot 5812164c-d345-4fb4-88d2-28f25c2fe3a6 {{(pid=80839) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 19 13:04:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:04:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:04:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:04:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:04:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:04:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:04:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Acquiring lock "cinder-quobyte-5058e817-6155-438e-8cd5-87ecf2e7cf2e" by "_copy_volume_from_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:04:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Lock "cinder-quobyte-5058e817-6155-438e-8cd5-87ecf2e7cf2e" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:04:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] snapshot: 5812164c-d345-4fb4-88d2-28f25c2fe3a6, volume: 5058e817-6155-438e-8cd5-87ecf2e7cf2e,  {{(pid=80839) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:392}}
Nov 19 13:04:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:04:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:04:19 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:04:19 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:04:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:04:19 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1757fa9-607a-4464-a72e-fb2185d22f67]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:04:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.5812164c-d345-4fb4-88d2-28f25c2fe3a6 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:19 devstack sudo[94503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.5812164c-d345-4fb4-88d2-28f25c2fe3a6
Nov 19 13:04:19 devstack sudo[94503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:19 devstack sudo[94503]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.5812164c-d345-4fb4-88d2-28f25c2fe3a6" returned: 0 in 0.619s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:19 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:04:19 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25 {{(pid=80839) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:411}}
Nov 19 13:04:19 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Creating direct copy from snapshot {{(pid=80839) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:419}}
Nov 19 13:04:19 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd555ac-4de3-4d1f-95ce-e577d32eae44]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:04:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:19 devstack sudo[94509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25
Nov 19 13:04:19 devstack sudo[94509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:20 devstack sudo[94509]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25" returned: 0 in 0.697s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:20 devstack cinder-volume[80839]: DEBUG cinder.utils [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Path /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5058e817-6155-438e-8cd5-87ecf2e7cf2e not found in is_blk_device check {{(pid=80839) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Nov 19 13:04:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5058e817-6155-438e-8cd5-87ecf2e7cf2e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:20 devstack sudo[94514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5058e817-6155-438e-8cd5-87ecf2e7cf2e
Nov 19 13:04:20 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:23 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5058e817-6155-438e-8cd5-87ecf2e7cf2e" returned: 0 in 2.938s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:23 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb742fcc-0e44-41ce-96b3-e301441cdba9]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:04:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:23 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cfbf41cd-b9bb-40d2-ac79-c7a8b976c489 tempest-BackendsCapabilitiesAdminTestsJSON-264262795 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 230.98544311523438, 'free_capacity_gb': 230.98544311523438, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=80839) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4798}}
Nov 19 13:04:23 devstack sudo[94530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25
Nov 19 13:04:23 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:23 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a3e21802-25f5-48b1-86b9-58ed72fd3f2d tempest-BackendsCapabilitiesAdminTestsJSON-264262795 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 230.98544311523438, 'free_capacity_gb': 230.98544311523438, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=80839) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4798}}
Nov 19 13:04:24 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25" returned: 0 in 0.738s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:24 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Image conversion details: src /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25, size 1024.00 MB, duration 2.94 sec, destination /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5058e817-6155-438e-8cd5-87ecf2e7cf2e {{(pid=80839) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 19 13:04:24 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Converted 1024.00 MB image at 348.38 MB/s
Nov 19 13:04:24 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5058e817-6155-438e-8cd5-87ecf2e7cf2e is being set with open permissions: ugo+rw
Nov 19 13:04:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5058e817-6155-438e-8cd5-87ecf2e7cf2e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:24 devstack sudo[94535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5058e817-6155-438e-8cd5-87ecf2e7cf2e
Nov 19 13:04:24 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:24 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5058e817-6155-438e-8cd5-87ecf2e7cf2e" returned: 0 in 0.496s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Lock "cinder-quobyte-5058e817-6155-438e-8cd5-87ecf2e7cf2e" released by "_copy_volume_from_snapshot" :: held 5.630s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:04:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Lock "cinder-quobyte-5812164c-d345-4fb4-88d2-28f25c2fe3a6-5058e817-6155-438e-8cd5-87ecf2e7cf2e" released by "_create_volume_from_snapshot" :: held 5.667s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:04:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.677s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:04:24 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (745f7670-9eae-453e-9e3e-9c2713198e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5058e817-6155-438e-8cd5-87ecf2e7cf2e', 'volume_size': 1, 'snapshot_id': '5812164c-d345-4fb4-88d2-28f25c2fe3a6'}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:24 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3051f2b4-54a4-4c21-8013-ba9a78bec9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:24 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Volume volume-5058e817-6155-438e-8cd5-87ecf2e7cf2e (5058e817-6155-438e-8cd5-87ecf2e7cf2e): created successfully
Nov 19 13:04:24 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3051f2b4-54a4-4c21-8013-ba9a78bec9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:24 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Flow 'volume_create_manager' (1bcc0742-1805-49d9-a3fa-684f04b4f4ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:04:24 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-7fe087e5-1753-4fc2-8f68-6d49963a3db5 tempest-VolumeDependencyTests-795960316 None] Created volume successfully.
Nov 19 13:04:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-daf950f3-5d52-4f75-bb20-55da32fd43b6 tempest-VolumeDependencyTests-795960316 None] Acquiring lock "cinder-5812164c-d345-4fb4-88d2-28f25c2fe3a6-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:04:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-daf950f3-5d52-4f75-bb20-55da32fd43b6 tempest-VolumeDependencyTests-795960316 None] Lock "cinder-5812164c-d345-4fb4-88d2-28f25c2fe3a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:04:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-daf950f3-5d52-4f75-bb20-55da32fd43b6 tempest-VolumeDependencyTests-795960316 None] Acquiring lock "cinder-quobyte-cc526cf8-f758-4c36-aa5c-6a8c11150f25" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:04:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-daf950f3-5d52-4f75-bb20-55da32fd43b6 tempest-VolumeDependencyTests-795960316 None] Lock "cinder-quobyte-cc526cf8-f758-4c36-aa5c-6a8c11150f25" acquired by "delete_snapshot" :: waited 0.015s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:04:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-daf950f3-5d52-4f75-bb20-55da32fd43b6 tempest-VolumeDependencyTests-795960316 None] Acquiring lock "cinder-quobyte-5812164c-d345-4fb4-88d2-28f25c2fe3a6" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:04:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-daf950f3-5d52-4f75-bb20-55da32fd43b6 tempest-VolumeDependencyTests-795960316 None] Lock "cinder-quobyte-5812164c-d345-4fb4-88d2-28f25c2fe3a6" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:04:25 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-daf950f3-5d52-4f75-bb20-55da32fd43b6 tempest-VolumeDependencyTests-795960316 None] Deleting offline snapshot 5812164c-d345-4fb4-88d2-28f25c2fe3a6 of volume cc526cf8-f758-4c36-aa5c-6a8c11150f25 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 13:04:25 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-daf950f3-5d52-4f75-bb20-55da32fd43b6 tempest-VolumeDependencyTests-795960316 None] snapshot_file for this snap is: volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.5812164c-d345-4fb4-88d2-28f25c2fe3a6 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 13:04:25 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f04b33b-ed6c-49ab-9048-690c77c13396]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:04:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-daf950f3-5d52-4f75-bb20-55da32fd43b6 tempest-VolumeDependencyTests-795960316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.5812164c-d345-4fb4-88d2-28f25c2fe3a6 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:25 devstack sudo[94538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.5812164c-d345-4fb4-88d2-28f25c2fe3a6
Nov 19 13:04:25 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:26 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-daf950f3-5d52-4f75-bb20-55da32fd43b6 tempest-VolumeDependencyTests-795960316 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.5812164c-d345-4fb4-88d2-28f25c2fe3a6" returned: 0 in 0.752s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-daf950f3-5d52-4f75-bb20-55da32fd43b6 tempest-VolumeDependencyTests-795960316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:04:26 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[085ba3d6-96a6-42ee-bcaa-62e42c1080a2]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:04:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-daf950f3-5d52-4f75-bb20-55da32fd43b6 tempest-VolumeDependencyTests-795960316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:26 devstack sudo[94544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25
Nov 19 13:04:26 devstack sudo[94544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:27 devstack sudo[94544]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-daf950f3-5d52-4f75-bb20-55da32fd43b6 tempest-VolumeDependencyTests-795960316 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25" returned: 0 in 0.824s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-daf950f3-5d52-4f75-bb20-55da32fd43b6 tempest-VolumeDependencyTests-795960316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.5812164c-d345-4fb4-88d2-28f25c2fe3a6 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:27 devstack sudo[94549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.5812164c-d345-4fb4-88d2-28f25c2fe3a6
Nov 19 13:04:27 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:27 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-daf950f3-5d52-4f75-bb20-55da32fd43b6 tempest-VolumeDependencyTests-795960316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.5812164c-d345-4fb4-88d2-28f25c2fe3a6" returned: 0 in 0.697s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-daf950f3-5d52-4f75-bb20-55da32fd43b6 tempest-VolumeDependencyTests-795960316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.5812164c-d345-4fb4-88d2-28f25c2fe3a6 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:27 devstack sudo[94554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.5812164c-d345-4fb4-88d2-28f25c2fe3a6
Nov 19 13:04:27 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:28 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-daf950f3-5d52-4f75-bb20-55da32fd43b6 tempest-VolumeDependencyTests-795960316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25.5812164c-d345-4fb4-88d2-28f25c2fe3a6" returned: 0 in 0.592s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:28 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-daf950f3-5d52-4f75-bb20-55da32fd43b6 tempest-VolumeDependencyTests-795960316 None] Lock "cinder-quobyte-5812164c-d345-4fb4-88d2-28f25c2fe3a6" released by "_delete_snapshot" :: held 2.984s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:04:28 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-daf950f3-5d52-4f75-bb20-55da32fd43b6 tempest-VolumeDependencyTests-795960316 None] Lock "cinder-quobyte-cc526cf8-f758-4c36-aa5c-6a8c11150f25" released by "delete_snapshot" :: held 2.997s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:04:28 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-daf950f3-5d52-4f75-bb20-55da32fd43b6 tempest-VolumeDependencyTests-795960316 None] Created reservations ['8dc4d394-57ba-4846-96f4-2977f9e5465e', '9c68e061-fc22-46e5-8ad8-2cd3a6a622b7', 'a71f410f-b3ff-4d53-8340-fe7dd87611ad', '9deb3b84-7ee2-42cc-b668-6b96d6fe6704'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:04:28 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-daf950f3-5d52-4f75-bb20-55da32fd43b6 tempest-VolumeDependencyTests-795960316 None] Delete snapshot completed successfully.
Nov 19 13:04:28 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-daf950f3-5d52-4f75-bb20-55da32fd43b6 tempest-VolumeDependencyTests-795960316 None] Lock "cinder-5812164c-d345-4fb4-88d2-28f25c2fe3a6-delete_snapshot" released by "delete_snapshot" :: held 3.102s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:04:28 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0919dcfc-5f1c-4f68-8b20-81ee151fc253 tempest-VolumeDependencyTests-795960316 None] Acquiring lock "cinder-cc526cf8-f758-4c36-aa5c-6a8c11150f25-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:04:28 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0919dcfc-5f1c-4f68-8b20-81ee151fc253 tempest-VolumeDependencyTests-795960316 None] Lock "cinder-cc526cf8-f758-4c36-aa5c-6a8c11150f25-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:04:28 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0919dcfc-5f1c-4f68-8b20-81ee151fc253 tempest-VolumeDependencyTests-795960316 None] Acquiring lock "cinder-quobyte-cc526cf8-f758-4c36-aa5c-6a8c11150f25" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:04:28 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0919dcfc-5f1c-4f68-8b20-81ee151fc253 tempest-VolumeDependencyTests-795960316 None] Lock "cinder-quobyte-cc526cf8-f758-4c36-aa5c-6a8c11150f25" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:04:28 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f775fb-c40c-4e14-8a5e-2326dad059f1]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:04:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0919dcfc-5f1c-4f68-8b20-81ee151fc253 tempest-VolumeDependencyTests-795960316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:28 devstack sudo[94564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25
Nov 19 13:04:28 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:29 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0919dcfc-5f1c-4f68-8b20-81ee151fc253 tempest-VolumeDependencyTests-795960316 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25" returned: 0 in 0.669s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0919dcfc-5f1c-4f68-8b20-81ee151fc253 tempest-VolumeDependencyTests-795960316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:29 devstack sudo[94569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25
Nov 19 13:04:29 devstack sudo[94569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:29 devstack sudo[94569]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0919dcfc-5f1c-4f68-8b20-81ee151fc253 tempest-VolumeDependencyTests-795960316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc526cf8-f758-4c36-aa5c-6a8c11150f25" returned: 0 in 0.539s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:29 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0919dcfc-5f1c-4f68-8b20-81ee151fc253 tempest-VolumeDependencyTests-795960316 None] Lock "cinder-quobyte-cc526cf8-f758-4c36-aa5c-6a8c11150f25" released by "delete_volume" :: held 1.242s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:04:29 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-0919dcfc-5f1c-4f68-8b20-81ee151fc253 tempest-VolumeDependencyTests-795960316 None] Created reservations ['5210510d-b42d-4ccc-8e63-377a6805cc68', 'a3765241-daa1-4c6b-bbd0-e6eee216ec18', '6b8c8167-b854-47a9-b87b-6fa3b63d7c67', 'b6ff71d6-e90c-43f8-8712-68b19bfa1197'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:04:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0919dcfc-5f1c-4f68-8b20-81ee151fc253 tempest-VolumeDependencyTests-795960316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:04:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0919dcfc-5f1c-4f68-8b20-81ee151fc253 tempest-VolumeDependencyTests-795960316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:04:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0919dcfc-5f1c-4f68-8b20-81ee151fc253 tempest-VolumeDependencyTests-795960316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:04:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0919dcfc-5f1c-4f68-8b20-81ee151fc253 tempest-VolumeDependencyTests-795960316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:04:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0919dcfc-5f1c-4f68-8b20-81ee151fc253 tempest-VolumeDependencyTests-795960316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:04:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0919dcfc-5f1c-4f68-8b20-81ee151fc253 tempest-VolumeDependencyTests-795960316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:30 devstack sudo[94572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:04:30 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:30 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0919dcfc-5f1c-4f68-8b20-81ee151fc253 tempest-VolumeDependencyTests-795960316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.484s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:30 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-0919dcfc-5f1c-4f68-8b20-81ee151fc253 tempest-VolumeDependencyTests-795960316 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:04:30 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-0919dcfc-5f1c-4f68-8b20-81ee151fc253 tempest-VolumeDependencyTests-795960316 None] Deleted volume successfully.
Nov 19 13:04:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0919dcfc-5f1c-4f68-8b20-81ee151fc253 tempest-VolumeDependencyTests-795960316 None] Lock "cinder-cc526cf8-f758-4c36-aa5c-6a8c11150f25-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:04:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-4b21edfc-9cae-40fb-a9ef-65250d1d7edb tempest-VolumeDependencyTests-795960316 None] Acquiring lock "cinder-5058e817-6155-438e-8cd5-87ecf2e7cf2e-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:04:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-4b21edfc-9cae-40fb-a9ef-65250d1d7edb tempest-VolumeDependencyTests-795960316 None] Lock "cinder-5058e817-6155-438e-8cd5-87ecf2e7cf2e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:04:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-4b21edfc-9cae-40fb-a9ef-65250d1d7edb tempest-VolumeDependencyTests-795960316 None] Acquiring lock "cinder-quobyte-5058e817-6155-438e-8cd5-87ecf2e7cf2e" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:04:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-4b21edfc-9cae-40fb-a9ef-65250d1d7edb tempest-VolumeDependencyTests-795960316 None] Lock "cinder-quobyte-5058e817-6155-438e-8cd5-87ecf2e7cf2e" acquired by "delete_volume" :: waited 0.017s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:04:30 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c2102c-3da7-4ff5-a634-f1541fe879d4]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:04:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4b21edfc-9cae-40fb-a9ef-65250d1d7edb tempest-VolumeDependencyTests-795960316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5058e817-6155-438e-8cd5-87ecf2e7cf2e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:31 devstack sudo[94576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5058e817-6155-438e-8cd5-87ecf2e7cf2e
Nov 19 13:04:31 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:31 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:04:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Flow 'volume_create_manager' (17a99713-590b-457b-a179-335462e47fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:04:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b22ca9ae-8a62-41f9-87c3-4777713dd4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b22ca9ae-8a62-41f9-87c3-4777713dd4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1713712152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a4ea3df-b04f-4e19-bc9d-f244aee44649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52bc1bb28a0d4fbeb4aa5de3b40afac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:04:32Z,use_quota=True,user_id='d2d6639bf5c74c93b37b90e4b51ac1b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5299d556-58bb-4862-b675-108c257b242d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5299d556-58bb-4862-b675-108c257b242d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b015005e-6b11-4548-8d92-74bbafbae55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b015005e-6b11-4548-8d92-74bbafbae55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a4ea3df-b04f-4e19-bc9d-f244aee44649', 'volume_name': 'volume-7a4ea3df-b04f-4e19-bc9d-f244aee44649', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a357978f-3d0b-4ce1-ac6a-98fd3ed3fc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a357978f-3d0b-4ce1-ac6a-98fd3ed3fc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (970cae53-6c83-4cb8-93ed-e0056fe2013f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:31 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Volume 7a4ea3df-b04f-4e19-bc9d-f244aee44649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a4ea3df-b04f-4e19-bc9d-f244aee44649', 'volume_size': 1}
Nov 19 13:04:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:04:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:04:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1713712152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a4ea3df-b04f-4e19-bc9d-f244aee44649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52bc1bb28a0d4fbeb4aa5de3b40afac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:04:32Z,use_quota=True,user_id='d2d6639bf5c74c93b37b90e4b51ac1b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:04:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Creating volume 7a4ea3df-b04f-4e19-bc9d-f244aee44649 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:04:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:04:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:04:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:04:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:04:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:04:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:04:31 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:04:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7a4ea3df-b04f-4e19-bc9d-f244aee44649 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:31 devstack sudo[94580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7a4ea3df-b04f-4e19-bc9d-f244aee44649 1073741824
Nov 19 13:04:31 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:31 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4b21edfc-9cae-40fb-a9ef-65250d1d7edb tempest-VolumeDependencyTests-795960316 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5058e817-6155-438e-8cd5-87ecf2e7cf2e" returned: 0 in 0.733s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4b21edfc-9cae-40fb-a9ef-65250d1d7edb tempest-VolumeDependencyTests-795960316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5058e817-6155-438e-8cd5-87ecf2e7cf2e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:31 devstack sudo[94583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5058e817-6155-438e-8cd5-87ecf2e7cf2e
Nov 19 13:04:31 devstack sudo[94583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:32 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7a4ea3df-b04f-4e19-bc9d-f244aee44649 1073741824" returned: 0 in 0.589s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7a4ea3df-b04f-4e19-bc9d-f244aee44649 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:32 devstack sudo[94589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7a4ea3df-b04f-4e19-bc9d-f244aee44649
Nov 19 13:04:32 devstack sudo[94589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:32 devstack sudo[94583]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4b21edfc-9cae-40fb-a9ef-65250d1d7edb tempest-VolumeDependencyTests-795960316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5058e817-6155-438e-8cd5-87ecf2e7cf2e" returned: 0 in 0.532s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:32 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-4b21edfc-9cae-40fb-a9ef-65250d1d7edb tempest-VolumeDependencyTests-795960316 None] Lock "cinder-quobyte-5058e817-6155-438e-8cd5-87ecf2e7cf2e" released by "delete_volume" :: held 1.300s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:04:32 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-4b21edfc-9cae-40fb-a9ef-65250d1d7edb tempest-VolumeDependencyTests-795960316 None] Created reservations ['b5e08dfb-ed6c-4b85-953c-f663b4b53976', '08197395-d640-4c1b-b385-5c6d4041cd52', '3dc8950e-b18c-4307-9f4a-1ad8075390bb', 'd74ba19b-aee4-48e9-8723-d1d621c72b44'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:04:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4b21edfc-9cae-40fb-a9ef-65250d1d7edb tempest-VolumeDependencyTests-795960316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:04:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4b21edfc-9cae-40fb-a9ef-65250d1d7edb tempest-VolumeDependencyTests-795960316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:04:32 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4b21edfc-9cae-40fb-a9ef-65250d1d7edb tempest-VolumeDependencyTests-795960316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:04:32 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4b21edfc-9cae-40fb-a9ef-65250d1d7edb tempest-VolumeDependencyTests-795960316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:04:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4b21edfc-9cae-40fb-a9ef-65250d1d7edb tempest-VolumeDependencyTests-795960316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:04:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4b21edfc-9cae-40fb-a9ef-65250d1d7edb tempest-VolumeDependencyTests-795960316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:32 devstack sudo[94591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:04:32 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:32 devstack sudo[94589]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7a4ea3df-b04f-4e19-bc9d-f244aee44649" returned: 0 in 0.547s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:32 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:04:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:04:32 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (970cae53-6c83-4cb8-93ed-e0056fe2013f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a4ea3df-b04f-4e19-bc9d-f244aee44649', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:32 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5be0a37-9202-4a8b-85c6-b45658866e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:32 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Volume volume-7a4ea3df-b04f-4e19-bc9d-f244aee44649 (7a4ea3df-b04f-4e19-bc9d-f244aee44649): created successfully
Nov 19 13:04:32 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5be0a37-9202-4a8b-85c6-b45658866e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:32 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Flow 'volume_create_manager' (17a99713-590b-457b-a179-335462e47fd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:04:32 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-3055cf45-5c43-4325-8429-ecbd532fb5da tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Created volume successfully.
Nov 19 13:04:32 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4b21edfc-9cae-40fb-a9ef-65250d1d7edb tempest-VolumeDependencyTests-795960316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.538s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:32 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-4b21edfc-9cae-40fb-a9ef-65250d1d7edb tempest-VolumeDependencyTests-795960316 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:04:32 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-4b21edfc-9cae-40fb-a9ef-65250d1d7edb tempest-VolumeDependencyTests-795960316 None] Deleted volume successfully.
Nov 19 13:04:32 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-4b21edfc-9cae-40fb-a9ef-65250d1d7edb tempest-VolumeDependencyTests-795960316 None] Lock "cinder-5058e817-6155-438e-8cd5-87ecf2e7cf2e-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:04:34 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-2b0ef967-f743-42cd-9746-60532bca8b33 tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Acquiring lock "cinder-7a4ea3df-b04f-4e19-bc9d-f244aee44649-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:04:34 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-2b0ef967-f743-42cd-9746-60532bca8b33 tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Lock "cinder-7a4ea3df-b04f-4e19-bc9d-f244aee44649-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:04:34 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-2b0ef967-f743-42cd-9746-60532bca8b33 tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Acquiring lock "cinder-quobyte-7a4ea3df-b04f-4e19-bc9d-f244aee44649" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:04:34 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-2b0ef967-f743-42cd-9746-60532bca8b33 tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Lock "cinder-quobyte-7a4ea3df-b04f-4e19-bc9d-f244aee44649" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:04:34 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad66e6c-2e34-410a-8871-adba86ce5f7c]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:04:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2b0ef967-f743-42cd-9746-60532bca8b33 tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7a4ea3df-b04f-4e19-bc9d-f244aee44649 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:34 devstack sudo[94652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7a4ea3df-b04f-4e19-bc9d-f244aee44649
Nov 19 13:04:34 devstack sudo[94652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:35 devstack sudo[94652]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2b0ef967-f743-42cd-9746-60532bca8b33 tempest-VolumeQuotasNegativeTestJSON-1418044540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7a4ea3df-b04f-4e19-bc9d-f244aee44649" returned: 0 in 0.634s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2b0ef967-f743-42cd-9746-60532bca8b33 tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7a4ea3df-b04f-4e19-bc9d-f244aee44649 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:35 devstack sudo[94669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7a4ea3df-b04f-4e19-bc9d-f244aee44649
Nov 19 13:04:35 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:35 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2b0ef967-f743-42cd-9746-60532bca8b33 tempest-VolumeQuotasNegativeTestJSON-1418044540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7a4ea3df-b04f-4e19-bc9d-f244aee44649" returned: 0 in 0.448s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:35 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-2b0ef967-f743-42cd-9746-60532bca8b33 tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Lock "cinder-quobyte-7a4ea3df-b04f-4e19-bc9d-f244aee44649" released by "delete_volume" :: held 1.122s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:04:36 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-2b0ef967-f743-42cd-9746-60532bca8b33 tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Created reservations ['56ee93e5-1989-4c9a-9ce8-7163670f84ab', 'e195d466-1101-462e-b757-a2b241153c6d', '34c82679-abd6-4349-a69f-ada42f21cd7a', '8e4e1fe8-03db-48dc-9777-7c5192cdd00b'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:04:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2b0ef967-f743-42cd-9746-60532bca8b33 tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:04:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2b0ef967-f743-42cd-9746-60532bca8b33 tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:04:36 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-2b0ef967-f743-42cd-9746-60532bca8b33 tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:04:36 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-2b0ef967-f743-42cd-9746-60532bca8b33 tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:04:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2b0ef967-f743-42cd-9746-60532bca8b33 tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:04:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2b0ef967-f743-42cd-9746-60532bca8b33 tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:36 devstack sudo[94672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:04:36 devstack sudo[94672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:36 devstack sudo[94672]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2b0ef967-f743-42cd-9746-60532bca8b33 tempest-VolumeQuotasNegativeTestJSON-1418044540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.480s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:36 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-2b0ef967-f743-42cd-9746-60532bca8b33 tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:04:36 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-2b0ef967-f743-42cd-9746-60532bca8b33 tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Deleted volume successfully.
Nov 19 13:04:36 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-2b0ef967-f743-42cd-9746-60532bca8b33 tempest-VolumeQuotasNegativeTestJSON-1418044540 None] Lock "cinder-7a4ea3df-b04f-4e19-bc9d-f244aee44649-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:04:40 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=88,cinder:INSERT=32,cinder:UPDATE=133,cinder:DELETE=9 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:04:40 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=87,cinder:INSERT=28,cinder:UPDATE=140,cinder:DELETE=15 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:04:40 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:04:40 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Flow 'volume_create_manager' (83146499-1ce3-4734-a70c-1fc695dcc320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:04:40 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edf0d39e-bf58-46e0-8d48-c849a4ce9b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:40 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edf0d39e-bf58-46e0-8d48-c849a4ce9b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1426454841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d650009e-957c-4fe0-b82a-0bca30294ec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5692da65dbd445c69555a1d1f00ad041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:04:40Z,use_quota=True,user_id='24ebe090d58c4fc18a154bc14e7d2452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b1c7b3f-f437-458e-b5dd-c3ca71b2b4c3),volume_type_id=7b1c7b3f-f437-458e-b5dd-c3ca71b2b4c3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:40 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88563dbf-f4d3-42a9-a22b-258ff3229ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:40 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88563dbf-f4d3-42a9-a22b-258ff3229ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:40 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233dc58e-8f64-4a69-b7f1-a5c842934fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:40 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233dc58e-8f64-4a69-b7f1-a5c842934fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd650009e-957c-4fe0-b82a-0bca30294ec2', 'volume_name': 'volume-d650009e-957c-4fe0-b82a-0bca30294ec2', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:40 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a17519cf-7295-46c3-b4cb-a5c14c57f567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:40 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a17519cf-7295-46c3-b4cb-a5c14c57f567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:40 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f79d7e07-9fd9-4bb3-ac81-08543170944e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:40 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Volume d650009e-957c-4fe0-b82a-0bca30294ec2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d650009e-957c-4fe0-b82a-0bca30294ec2', 'volume_size': 1}
Nov 19 13:04:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:04:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:04:40 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1426454841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d650009e-957c-4fe0-b82a-0bca30294ec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5692da65dbd445c69555a1d1f00ad041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:04:40Z,use_quota=True,user_id='24ebe090d58c4fc18a154bc14e7d2452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b1c7b3f-f437-458e-b5dd-c3ca71b2b4c3),volume_type_id=7b1c7b3f-f437-458e-b5dd-c3ca71b2b4c3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:04:40 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Creating volume d650009e-957c-4fe0-b82a-0bca30294ec2 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:04:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:04:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:04:40 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:04:40 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:04:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:04:40 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:04:40 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:04:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d650009e-957c-4fe0-b82a-0bca30294ec2 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:40 devstack sudo[94676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d650009e-957c-4fe0-b82a-0bca30294ec2 1073741824
Nov 19 13:04:40 devstack sudo[94676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:40 devstack sudo[94676]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d650009e-957c-4fe0-b82a-0bca30294ec2 1073741824" returned: 0 in 0.578s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d650009e-957c-4fe0-b82a-0bca30294ec2 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:40 devstack sudo[94681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d650009e-957c-4fe0-b82a-0bca30294ec2
Nov 19 13:04:40 devstack sudo[94681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:41 devstack sudo[94681]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d650009e-957c-4fe0-b82a-0bca30294ec2" returned: 0 in 0.460s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:41 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:04:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:04:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f79d7e07-9fd9-4bb3-ac81-08543170944e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d650009e-957c-4fe0-b82a-0bca30294ec2', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed353a00-0956-4e77-a20f-30fbfd6f1a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:41 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Volume volume-d650009e-957c-4fe0-b82a-0bca30294ec2 (d650009e-957c-4fe0-b82a-0bca30294ec2): created successfully
Nov 19 13:04:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed353a00-0956-4e77-a20f-30fbfd6f1a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Flow 'volume_create_manager' (83146499-1ce3-4734-a70c-1fc695dcc320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:04:41 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-5ac7bad6-1c63-4610-8796-bd2f6375dec6 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Created volume successfully.
Nov 19 13:04:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-addd5fea-9e38-4ff3-8672-644d4762b920 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:04:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-addd5fea-9e38-4ff3-8672-644d4762b920 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:04:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-addd5fea-9e38-4ff3-8672-644d4762b920 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:04:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-addd5fea-9e38-4ff3-8672-644d4762b920 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:04:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-addd5fea-9e38-4ff3-8672-644d4762b920 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:04:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-addd5fea-9e38-4ff3-8672-644d4762b920 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:42 devstack sudo[94684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:04:42 devstack sudo[94684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:42 devstack sudo[94684]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-addd5fea-9e38-4ff3-8672-644d4762b920 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.420s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:42 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-addd5fea-9e38-4ff3-8672-644d4762b920 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:04:42 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-addd5fea-9e38-4ff3-8672-644d4762b920 tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Retype volume completed successfully.
Nov 19 13:04:43 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6fae18f6-f312-4f67-8634-100ec808acbd tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Acquiring lock "cinder-d650009e-957c-4fe0-b82a-0bca30294ec2-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:04:43 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6fae18f6-f312-4f67-8634-100ec808acbd tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Lock "cinder-d650009e-957c-4fe0-b82a-0bca30294ec2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:04:43 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6fae18f6-f312-4f67-8634-100ec808acbd tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Acquiring lock "cinder-quobyte-d650009e-957c-4fe0-b82a-0bca30294ec2" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:04:43 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6fae18f6-f312-4f67-8634-100ec808acbd tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Lock "cinder-quobyte-d650009e-957c-4fe0-b82a-0bca30294ec2" acquired by "delete_volume" :: waited 0.006s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:04:43 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fdefac-46ac-4c83-a718-a6eff71e43c6]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:04:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6fae18f6-f312-4f67-8634-100ec808acbd tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d650009e-957c-4fe0-b82a-0bca30294ec2 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:43 devstack sudo[94688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d650009e-957c-4fe0-b82a-0bca30294ec2
Nov 19 13:04:43 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:44 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6fae18f6-f312-4f67-8634-100ec808acbd tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d650009e-957c-4fe0-b82a-0bca30294ec2" returned: 0 in 0.534s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6fae18f6-f312-4f67-8634-100ec808acbd tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d650009e-957c-4fe0-b82a-0bca30294ec2 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:44 devstack sudo[94693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d650009e-957c-4fe0-b82a-0bca30294ec2
Nov 19 13:04:44 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:44 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6fae18f6-f312-4f67-8634-100ec808acbd tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d650009e-957c-4fe0-b82a-0bca30294ec2" returned: 0 in 0.459s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:44 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6fae18f6-f312-4f67-8634-100ec808acbd tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Lock "cinder-quobyte-d650009e-957c-4fe0-b82a-0bca30294ec2" released by "delete_volume" :: held 1.014s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:04:44 devstack cinder-volume[80839]: WARNING cinder.quota [None req-6fae18f6-f312-4f67-8634-100ec808acbd tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 19 13:04:44 devstack cinder-volume[80839]: WARNING cinder.quota [None req-6fae18f6-f312-4f67-8634-100ec808acbd tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 19 13:04:44 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-6fae18f6-f312-4f67-8634-100ec808acbd tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Created reservations ['7041fe16-48e1-4196-baee-ded8dc20edca', '1c0d6feb-3198-416c-8c8a-9e2877ba4eb2', 'ff4d2a8f-86b7-4f6c-a7f2-46eb9a2cc4c2', '612d4189-2e23-4e29-b5bf-508464758283'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:04:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6fae18f6-f312-4f67-8634-100ec808acbd tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:04:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6fae18f6-f312-4f67-8634-100ec808acbd tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:04:44 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6fae18f6-f312-4f67-8634-100ec808acbd tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:04:44 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6fae18f6-f312-4f67-8634-100ec808acbd tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:04:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6fae18f6-f312-4f67-8634-100ec808acbd tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:04:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6fae18f6-f312-4f67-8634-100ec808acbd tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:44 devstack sudo[94696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:04:44 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:45 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6fae18f6-f312-4f67-8634-100ec808acbd tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.440s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:45 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-6fae18f6-f312-4f67-8634-100ec808acbd tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:04:45 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-6fae18f6-f312-4f67-8634-100ec808acbd tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Deleted volume successfully.
Nov 19 13:04:45 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6fae18f6-f312-4f67-8634-100ec808acbd tempest-VolumeRetypeWithoutMigrationTest-1154619270 None] Lock "cinder-d650009e-957c-4fe0-b82a-0bca30294ec2-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:04:49 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:04:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Flow 'volume_create_manager' (0d0ceb56-841f-4a29-8b88-bb4d48519abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:04:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (effc451b-2241-47f3-b5bc-1efece068fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (effc451b-2241-47f3-b5bc-1efece068fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-641430585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa508f2-5cb5-4667-9e2a-1959e6f703b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='833d3332107c462cb837cbe4ddaab3a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:04:49Z,use_quota=True,user_id='ae4a52ab57104e309a24cbabf9f2632c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f142f2f-e264-47c6-94f6-48e3a5641cc0),volume_type_id=4f142f2f-e264-47c6-94f6-48e3a5641cc0)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cdd78ab-918b-4c74-8311-76d46996e630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cdd78ab-918b-4c74-8311-76d46996e630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38dc58ae-0b9d-463a-83a6-5c926b938bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38dc58ae-0b9d-463a-83a6-5c926b938bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fa508f2-5cb5-4667-9e2a-1959e6f703b2', 'volume_name': 'volume-8fa508f2-5cb5-4667-9e2a-1959e6f703b2', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (340b6a68-c758-40c8-83e4-5ff2d55b7a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (340b6a68-c758-40c8-83e4-5ff2d55b7a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d1c81e-e4eb-4338-a9e9-167546142a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:49 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Volume 8fa508f2-5cb5-4667-9e2a-1959e6f703b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fa508f2-5cb5-4667-9e2a-1959e6f703b2', 'volume_size': 1}
Nov 19 13:04:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:04:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:04:49 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-641430585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa508f2-5cb5-4667-9e2a-1959e6f703b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='833d3332107c462cb837cbe4ddaab3a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:04:49Z,use_quota=True,user_id='ae4a52ab57104e309a24cbabf9f2632c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f142f2f-e264-47c6-94f6-48e3a5641cc0),volume_type_id=4f142f2f-e264-47c6-94f6-48e3a5641cc0)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:04:49 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Creating volume 8fa508f2-5cb5-4667-9e2a-1959e6f703b2 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:04:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:04:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:04:49 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:04:49 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:04:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:04:49 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:04:49 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:04:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8fa508f2-5cb5-4667-9e2a-1959e6f703b2 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:49 devstack sudo[94715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8fa508f2-5cb5-4667-9e2a-1959e6f703b2 1073741824
Nov 19 13:04:49 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:49 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8fa508f2-5cb5-4667-9e2a-1959e6f703b2 1073741824" returned: 0 in 0.572s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8fa508f2-5cb5-4667-9e2a-1959e6f703b2 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:50 devstack sudo[94720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8fa508f2-5cb5-4667-9e2a-1959e6f703b2
Nov 19 13:04:50 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:50 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8fa508f2-5cb5-4667-9e2a-1959e6f703b2" returned: 0 in 0.465s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:50 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:04:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:04:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d1c81e-e4eb-4338-a9e9-167546142a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fa508f2-5cb5-4667-9e2a-1959e6f703b2', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b055be9-6d58-4f7b-b1f5-ebb53cb8f648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:04:50 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Volume volume-8fa508f2-5cb5-4667-9e2a-1959e6f703b2 (8fa508f2-5cb5-4667-9e2a-1959e6f703b2): created successfully
Nov 19 13:04:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b055be9-6d58-4f7b-b1f5-ebb53cb8f648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:04:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Flow 'volume_create_manager' (0d0ceb56-841f-4a29-8b88-bb4d48519abf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:04:50 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-c3ec8ba0-ebf9-48ab-87bd-a2c7df932640 tempest-VolumeTypesAccessTest-870460863 None] Created volume successfully.
Nov 19 13:04:51 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-36ef00f7-ea7f-4a60-9cd1-93a0d736d444 tempest-VolumeTypesAccessTest-870460863 None] Acquiring lock "cinder-8fa508f2-5cb5-4667-9e2a-1959e6f703b2-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:04:51 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-36ef00f7-ea7f-4a60-9cd1-93a0d736d444 tempest-VolumeTypesAccessTest-870460863 None] Lock "cinder-8fa508f2-5cb5-4667-9e2a-1959e6f703b2-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:04:51 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-36ef00f7-ea7f-4a60-9cd1-93a0d736d444 tempest-VolumeTypesAccessTest-870460863 None] Acquiring lock "cinder-quobyte-8fa508f2-5cb5-4667-9e2a-1959e6f703b2" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:04:51 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-36ef00f7-ea7f-4a60-9cd1-93a0d736d444 tempest-VolumeTypesAccessTest-870460863 None] Lock "cinder-quobyte-8fa508f2-5cb5-4667-9e2a-1959e6f703b2" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:04:51 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb69197-69e2-487b-aaea-a6172aaa0042]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:04:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-36ef00f7-ea7f-4a60-9cd1-93a0d736d444 tempest-VolumeTypesAccessTest-870460863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8fa508f2-5cb5-4667-9e2a-1959e6f703b2 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:51 devstack sudo[94727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8fa508f2-5cb5-4667-9e2a-1959e6f703b2
Nov 19 13:04:51 devstack sudo[94727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:52 devstack sudo[94727]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-36ef00f7-ea7f-4a60-9cd1-93a0d736d444 tempest-VolumeTypesAccessTest-870460863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8fa508f2-5cb5-4667-9e2a-1959e6f703b2" returned: 0 in 0.551s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-36ef00f7-ea7f-4a60-9cd1-93a0d736d444 tempest-VolumeTypesAccessTest-870460863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8fa508f2-5cb5-4667-9e2a-1959e6f703b2 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:52 devstack sudo[94735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8fa508f2-5cb5-4667-9e2a-1959e6f703b2
Nov 19 13:04:52 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:52 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-36ef00f7-ea7f-4a60-9cd1-93a0d736d444 tempest-VolumeTypesAccessTest-870460863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8fa508f2-5cb5-4667-9e2a-1959e6f703b2" returned: 0 in 0.488s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:52 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-36ef00f7-ea7f-4a60-9cd1-93a0d736d444 tempest-VolumeTypesAccessTest-870460863 None] Lock "cinder-quobyte-8fa508f2-5cb5-4667-9e2a-1959e6f703b2" released by "delete_volume" :: held 1.074s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:04:52 devstack cinder-volume[80839]: WARNING cinder.quota [None req-36ef00f7-ea7f-4a60-9cd1-93a0d736d444 tempest-VolumeTypesAccessTest-870460863 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-16658995 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-16658995, it is now deprecated. Please use the default quota class for default quota.
Nov 19 13:04:52 devstack cinder-volume[80839]: WARNING cinder.quota [None req-36ef00f7-ea7f-4a60-9cd1-93a0d736d444 tempest-VolumeTypesAccessTest-870460863 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-16658995 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-16658995, it is now deprecated. Please use the default quota class for default quota.
Nov 19 13:04:52 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-36ef00f7-ea7f-4a60-9cd1-93a0d736d444 tempest-VolumeTypesAccessTest-870460863 None] Created reservations ['4888e640-6fcc-45c6-8676-7f4287a6b308', '5eb97b70-b3d4-4ed5-98a7-eacc4dc9c545', '8c98fbbf-36a0-4ad8-ad22-d586333a42d6', '50b27ad1-c930-4cd6-b0d9-0c1e65042142'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:04:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-36ef00f7-ea7f-4a60-9cd1-93a0d736d444 tempest-VolumeTypesAccessTest-870460863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:04:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-36ef00f7-ea7f-4a60-9cd1-93a0d736d444 tempest-VolumeTypesAccessTest-870460863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:04:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-36ef00f7-ea7f-4a60-9cd1-93a0d736d444 tempest-VolumeTypesAccessTest-870460863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:04:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-36ef00f7-ea7f-4a60-9cd1-93a0d736d444 tempest-VolumeTypesAccessTest-870460863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:04:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-36ef00f7-ea7f-4a60-9cd1-93a0d736d444 tempest-VolumeTypesAccessTest-870460863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:04:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-36ef00f7-ea7f-4a60-9cd1-93a0d736d444 tempest-VolumeTypesAccessTest-870460863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:04:52 devstack sudo[94744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:04:52 devstack sudo[94744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:04:53 devstack sudo[94744]: pam_unix(sudo:session): session closed for user root
Nov 19 13:04:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-36ef00f7-ea7f-4a60-9cd1-93a0d736d444 tempest-VolumeTypesAccessTest-870460863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.447s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:04:53 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-36ef00f7-ea7f-4a60-9cd1-93a0d736d444 tempest-VolumeTypesAccessTest-870460863 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:04:53 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-36ef00f7-ea7f-4a60-9cd1-93a0d736d444 tempest-VolumeTypesAccessTest-870460863 None] Deleted volume successfully.
Nov 19 13:04:53 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-36ef00f7-ea7f-4a60-9cd1-93a0d736d444 tempest-VolumeTypesAccessTest-870460863 None] Lock "cinder-8fa508f2-5cb5-4667-9e2a-1959e6f703b2-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:05:02 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=17,cinder:UPDATE=27,cinder:DELETE=3,cinder:INSERT=4 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:05:03 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:UPDATE=21,cinder:SELECT=20,cinder:INSERT=4,cinder:DELETE=1 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:05:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 13:05:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:05:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:05:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:05:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:05:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:05:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:05:04 devstack sudo[94757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:05:04 devstack sudo[94757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:05:05 devstack sudo[94757]: pam_unix(sudo:session): session closed for user root
Nov 19 13:05:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.504s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:05:05 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:05:17 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-81075f1a-0fff-41e5-a5be-cc696f1842be req-1d202700-6045-40ba-840e-17ebc616768c tempest-TestMinimumBasicScenario-1631171406 None] Terminate volume connection completed successfully.
Nov 19 13:05:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-81075f1a-0fff-41e5-a5be-cc696f1842be req-1d202700-6045-40ba-840e-17ebc616768c tempest-TestMinimumBasicScenario-1631171406 None] Deleting attachment a2a1f661-53e3-49a6-94ea-585394041fe1. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 13:05:19 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-45c7840e-584b-4d03-8256-75af228cc6b5 tempest-TestMinimumBasicScenario-1631171406 None] Acquiring lock "cinder-da667de8-0023-4a16-a4f5-11bbfe1f8619-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:05:19 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-45c7840e-584b-4d03-8256-75af228cc6b5 tempest-TestMinimumBasicScenario-1631171406 None] Lock "cinder-da667de8-0023-4a16-a4f5-11bbfe1f8619-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:05:19 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-45c7840e-584b-4d03-8256-75af228cc6b5 tempest-TestMinimumBasicScenario-1631171406 None] Acquiring lock "cinder-quobyte-da667de8-0023-4a16-a4f5-11bbfe1f8619" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:05:19 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-45c7840e-584b-4d03-8256-75af228cc6b5 tempest-TestMinimumBasicScenario-1631171406 None] Lock "cinder-quobyte-da667de8-0023-4a16-a4f5-11bbfe1f8619" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:05:19 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be0d002-5227-4a0f-84b9-7ffa0c237863]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:05:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-45c7840e-584b-4d03-8256-75af228cc6b5 tempest-TestMinimumBasicScenario-1631171406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da667de8-0023-4a16-a4f5-11bbfe1f8619 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:05:19 devstack sudo[94815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da667de8-0023-4a16-a4f5-11bbfe1f8619
Nov 19 13:05:19 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:05:19 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root
Nov 19 13:05:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-45c7840e-584b-4d03-8256-75af228cc6b5 tempest-TestMinimumBasicScenario-1631171406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da667de8-0023-4a16-a4f5-11bbfe1f8619" returned: 0 in 0.567s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:05:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-45c7840e-584b-4d03-8256-75af228cc6b5 tempest-TestMinimumBasicScenario-1631171406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da667de8-0023-4a16-a4f5-11bbfe1f8619 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:05:19 devstack sudo[94820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da667de8-0023-4a16-a4f5-11bbfe1f8619
Nov 19 13:05:19 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:05:20 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root
Nov 19 13:05:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-45c7840e-584b-4d03-8256-75af228cc6b5 tempest-TestMinimumBasicScenario-1631171406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da667de8-0023-4a16-a4f5-11bbfe1f8619" returned: 0 in 0.499s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:05:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-45c7840e-584b-4d03-8256-75af228cc6b5 tempest-TestMinimumBasicScenario-1631171406 None] Lock "cinder-quobyte-da667de8-0023-4a16-a4f5-11bbfe1f8619" released by "delete_volume" :: held 1.092s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:05:20 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-45c7840e-584b-4d03-8256-75af228cc6b5 tempest-TestMinimumBasicScenario-1631171406 None] Created reservations ['ed3cf28e-8f7d-4cdd-96b6-3c3d832babb5', '656fc2cc-a4ad-4fc3-b962-6fe21c9cb8d4', 'a5fddb0c-dde1-474d-b33d-e4fe663a8533', 'e3c94f38-c788-462c-b70b-7457463a66ce'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:05:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-45c7840e-584b-4d03-8256-75af228cc6b5 tempest-TestMinimumBasicScenario-1631171406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:05:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-45c7840e-584b-4d03-8256-75af228cc6b5 tempest-TestMinimumBasicScenario-1631171406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:05:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-45c7840e-584b-4d03-8256-75af228cc6b5 tempest-TestMinimumBasicScenario-1631171406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:05:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-45c7840e-584b-4d03-8256-75af228cc6b5 tempest-TestMinimumBasicScenario-1631171406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:05:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-45c7840e-584b-4d03-8256-75af228cc6b5 tempest-TestMinimumBasicScenario-1631171406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:05:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-45c7840e-584b-4d03-8256-75af228cc6b5 tempest-TestMinimumBasicScenario-1631171406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:05:20 devstack sudo[94836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:05:20 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:05:20 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root
Nov 19 13:05:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-45c7840e-584b-4d03-8256-75af228cc6b5 tempest-TestMinimumBasicScenario-1631171406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.431s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:05:20 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-45c7840e-584b-4d03-8256-75af228cc6b5 tempest-TestMinimumBasicScenario-1631171406 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:05:20 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-45c7840e-584b-4d03-8256-75af228cc6b5 tempest-TestMinimumBasicScenario-1631171406 None] Deleted volume successfully.
Nov 19 13:05:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-45c7840e-584b-4d03-8256-75af228cc6b5 tempest-TestMinimumBasicScenario-1631171406 None] Lock "cinder-da667de8-0023-4a16-a4f5-11bbfe1f8619-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:05:28 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:05:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Flow 'volume_create_manager' (93fcac60-bedb-451a-bf1e-ab1e7196729b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:05:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e8176e3-567e-41b8-8670-9c3f2c7205eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e8176e3-567e-41b8-8670-9c3f2c7205eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-514332651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fce15e7a-4bc0-4239-9e90-9d8696684a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23bcf889e12344c199580bfb81aec013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:05:29Z,use_quota=True,user_id='6690079916344250bc4f3ec3f15f68a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b2220e-7669-4e81-adc6-66f62a831368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b2220e-7669-4e81-adc6-66f62a831368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (743cff57-cf97-48b4-837e-ff6c081f127a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (743cff57-cf97-48b4-837e-ff6c081f127a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fce15e7a-4bc0-4239-9e90-9d8696684a9b', 'volume_name': 'volume-fce15e7a-4bc0-4239-9e90-9d8696684a9b', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1ec746-a44e-47e3-bb1d-c9ae360ac445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1ec746-a44e-47e3-bb1d-c9ae360ac445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f03c56-37ff-441a-9c84-0b9b5da6624c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:28 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Volume fce15e7a-4bc0-4239-9e90-9d8696684a9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fce15e7a-4bc0-4239-9e90-9d8696684a9b', 'volume_size': 1}
Nov 19 13:05:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:05:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:05:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-514332651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fce15e7a-4bc0-4239-9e90-9d8696684a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23bcf889e12344c199580bfb81aec013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:05:29Z,use_quota=True,user_id='6690079916344250bc4f3ec3f15f68a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:05:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Creating volume fce15e7a-4bc0-4239-9e90-9d8696684a9b {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:05:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:05:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:05:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:05:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:05:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:05:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:05:28 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:05:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fce15e7a-4bc0-4239-9e90-9d8696684a9b 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:05:28 devstack sudo[94959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fce15e7a-4bc0-4239-9e90-9d8696684a9b 1073741824
Nov 19 13:05:28 devstack sudo[94959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:05:29 devstack sudo[94959]: pam_unix(sudo:session): session closed for user root
Nov 19 13:05:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fce15e7a-4bc0-4239-9e90-9d8696684a9b 1073741824" returned: 0 in 0.772s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:05:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fce15e7a-4bc0-4239-9e90-9d8696684a9b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:05:29 devstack sudo[94964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fce15e7a-4bc0-4239-9e90-9d8696684a9b
Nov 19 13:05:29 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:05:29 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root
Nov 19 13:05:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fce15e7a-4bc0-4239-9e90-9d8696684a9b" returned: 0 in 0.528s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:05:29 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:05:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:05:29 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f03c56-37ff-441a-9c84-0b9b5da6624c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fce15e7a-4bc0-4239-9e90-9d8696684a9b', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74fee099-3f3e-47fb-a83c-a0beb5610bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:30 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Volume volume-fce15e7a-4bc0-4239-9e90-9d8696684a9b (fce15e7a-4bc0-4239-9e90-9d8696684a9b): created successfully
Nov 19 13:05:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74fee099-3f3e-47fb-a83c-a0beb5610bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Flow 'volume_create_manager' (93fcac60-bedb-451a-bf1e-ab1e7196729b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:05:30 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-92810e81-8548-434e-aeb0-e3e1ffc94441 tempest-VolumesActionsTest-1876506846 None] Created volume successfully.
Nov 19 13:05:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-93ef1be8-c831-46b2-92da-c1737e15c7c1 tempest-VolumesActionsTest-1876506846 None] Acquiring lock "cinder-fce15e7a-4bc0-4239-9e90-9d8696684a9b" by "attach_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:05:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-93ef1be8-c831-46b2-92da-c1737e15c7c1 tempest-VolumesActionsTest-1876506846 None] Lock "cinder-fce15e7a-4bc0-4239-9e90-9d8696684a9b" acquired by "attach_volume" :: waited 0.015s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:05:30 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-93ef1be8-c831-46b2-92da-c1737e15c7c1 tempest-VolumesActionsTest-1876506846 None] Attaching volume fce15e7a-4bc0-4239-9e90-9d8696684a9b to instance 3a617023-f103-463e-875c-e9505ad6c835 at mountpoint /dev/vdb on host None.
Nov 19 13:05:30 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-93ef1be8-c831-46b2-92da-c1737e15c7c1 tempest-VolumesActionsTest-1876506846 None] Attach volume completed successfully.
Nov 19 13:05:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-93ef1be8-c831-46b2-92da-c1737e15c7c1 tempest-VolumesActionsTest-1876506846 None] Lock "cinder-fce15e7a-4bc0-4239-9e90-9d8696684a9b" released by "attach_volume" :: held 0.098s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:05:31 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-b7778087-56e9-412c-8e2b-d5629bc9741e tempest-VolumesActionsTest-241571659 None] Terminate volume connection completed successfully.
Nov 19 13:05:32 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b7778087-56e9-412c-8e2b-d5629bc9741e tempest-VolumesActionsTest-241571659 None] Acquiring lock "cinder-fce15e7a-4bc0-4239-9e90-9d8696684a9b-detach_volume" by "detach_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:05:32 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b7778087-56e9-412c-8e2b-d5629bc9741e tempest-VolumesActionsTest-241571659 None] Lock "cinder-fce15e7a-4bc0-4239-9e90-9d8696684a9b-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:05:32 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-b7778087-56e9-412c-8e2b-d5629bc9741e tempest-VolumesActionsTest-241571659 None] Detaching volume fce15e7a-4bc0-4239-9e90-9d8696684a9b from instance 3a617023-f103-463e-875c-e9505ad6c835.
Nov 19 13:05:32 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-b7778087-56e9-412c-8e2b-d5629bc9741e tempest-VolumesActionsTest-241571659 None] Detach volume completed successfully.
Nov 19 13:05:32 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b7778087-56e9-412c-8e2b-d5629bc9741e tempest-VolumesActionsTest-241571659 None] Lock "cinder-fce15e7a-4bc0-4239-9e90-9d8696684a9b-detach_volume" released by "detach_volume" :: held 0.056s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:05:32 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-aa1e98a8-f2f5-4104-ae82-c856664886d7 tempest-VolumesActionsTest-1876506846 None] Acquiring lock "cinder-fce15e7a-4bc0-4239-9e90-9d8696684a9b-detach_volume" by "detach_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:05:32 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-aa1e98a8-f2f5-4104-ae82-c856664886d7 tempest-VolumesActionsTest-1876506846 None] Lock "cinder-fce15e7a-4bc0-4239-9e90-9d8696684a9b-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:05:32 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-aa1e98a8-f2f5-4104-ae82-c856664886d7 tempest-VolumesActionsTest-1876506846 None] Volume detach called, but volume not attached.
Nov 19 13:05:32 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-aa1e98a8-f2f5-4104-ae82-c856664886d7 tempest-VolumesActionsTest-1876506846 None] Lock "cinder-fce15e7a-4bc0-4239-9e90-9d8696684a9b-detach_volume" released by "detach_volume" :: held 0.019s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:05:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f03c7b33-0010-4738-99ac-2e29aaa9e06d tempest-VolumesActionsTest-1876506846 None] Acquiring lock "cinder-fce15e7a-4bc0-4239-9e90-9d8696684a9b-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:05:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f03c7b33-0010-4738-99ac-2e29aaa9e06d tempest-VolumesActionsTest-1876506846 None] Lock "cinder-fce15e7a-4bc0-4239-9e90-9d8696684a9b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:05:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f03c7b33-0010-4738-99ac-2e29aaa9e06d tempest-VolumesActionsTest-1876506846 None] Acquiring lock "cinder-quobyte-fce15e7a-4bc0-4239-9e90-9d8696684a9b" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:05:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f03c7b33-0010-4738-99ac-2e29aaa9e06d tempest-VolumesActionsTest-1876506846 None] Lock "cinder-quobyte-fce15e7a-4bc0-4239-9e90-9d8696684a9b" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:05:33 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cf2169-46d1-4f85-816e-f76da226544f]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:05:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f03c7b33-0010-4738-99ac-2e29aaa9e06d tempest-VolumesActionsTest-1876506846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fce15e7a-4bc0-4239-9e90-9d8696684a9b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:05:33 devstack sudo[94990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fce15e7a-4bc0-4239-9e90-9d8696684a9b
Nov 19 13:05:33 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:05:34 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root
Nov 19 13:05:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f03c7b33-0010-4738-99ac-2e29aaa9e06d tempest-VolumesActionsTest-1876506846 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fce15e7a-4bc0-4239-9e90-9d8696684a9b" returned: 0 in 0.797s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:05:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f03c7b33-0010-4738-99ac-2e29aaa9e06d tempest-VolumesActionsTest-1876506846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fce15e7a-4bc0-4239-9e90-9d8696684a9b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:05:34 devstack sudo[95035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fce15e7a-4bc0-4239-9e90-9d8696684a9b
Nov 19 13:05:34 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:05:35 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root
Nov 19 13:05:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f03c7b33-0010-4738-99ac-2e29aaa9e06d tempest-VolumesActionsTest-1876506846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fce15e7a-4bc0-4239-9e90-9d8696684a9b" returned: 0 in 0.745s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:05:35 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f03c7b33-0010-4738-99ac-2e29aaa9e06d tempest-VolumesActionsTest-1876506846 None] Lock "cinder-quobyte-fce15e7a-4bc0-4239-9e90-9d8696684a9b" released by "delete_volume" :: held 1.572s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:05:35 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-f03c7b33-0010-4738-99ac-2e29aaa9e06d tempest-VolumesActionsTest-1876506846 None] Created reservations ['5abd753f-b216-400f-8e03-73a5e6fcf168', 'a871ee77-7985-4f87-907b-73cb213c3c35', 'a05b6452-8ada-4ea6-a017-46059bc1d28e', '1258b5ff-f68b-40d8-b2ae-3351e27594c5'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:05:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f03c7b33-0010-4738-99ac-2e29aaa9e06d tempest-VolumesActionsTest-1876506846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:05:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f03c7b33-0010-4738-99ac-2e29aaa9e06d tempest-VolumesActionsTest-1876506846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:05:35 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-f03c7b33-0010-4738-99ac-2e29aaa9e06d tempest-VolumesActionsTest-1876506846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:05:35 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-f03c7b33-0010-4738-99ac-2e29aaa9e06d tempest-VolumesActionsTest-1876506846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:05:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f03c7b33-0010-4738-99ac-2e29aaa9e06d tempest-VolumesActionsTest-1876506846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:05:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f03c7b33-0010-4738-99ac-2e29aaa9e06d tempest-VolumesActionsTest-1876506846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:05:35 devstack sudo[95098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:05:35 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:05:36 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root
Nov 19 13:05:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f03c7b33-0010-4738-99ac-2e29aaa9e06d tempest-VolumesActionsTest-1876506846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 1.063s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:05:36 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-f03c7b33-0010-4738-99ac-2e29aaa9e06d tempest-VolumesActionsTest-1876506846 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:05:36 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-f03c7b33-0010-4738-99ac-2e29aaa9e06d tempest-VolumesActionsTest-1876506846 None] Deleted volume successfully.
Nov 19 13:05:36 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f03c7b33-0010-4738-99ac-2e29aaa9e06d tempest-VolumesActionsTest-1876506846 None] Lock "cinder-fce15e7a-4bc0-4239-9e90-9d8696684a9b-delete_volume" released by "delete_volume" :: held 2.952s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:05:42 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:05:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Flow 'volume_create_manager' (926cc068-864b-44f1-a403-f90b2d489382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:05:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93b1885b-1226-4838-954c-d506e70e8f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93b1885b-1226-4838-954c-d506e70e8f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1819464732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44bdb3c3-e2d9-41f5-afe4-e28745df26a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23bcf889e12344c199580bfb81aec013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:05:43Z,use_quota=True,user_id='6690079916344250bc4f3ec3f15f68a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6645a06-6081-455e-9621-d8e269a94a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6645a06-6081-455e-9621-d8e269a94a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b159d1e7-727e-4e02-aa8b-989020c738b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b159d1e7-727e-4e02-aa8b-989020c738b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44bdb3c3-e2d9-41f5-afe4-e28745df26a8', 'volume_name': 'volume-44bdb3c3-e2d9-41f5-afe4-e28745df26a8', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ec4297-7e8c-481d-b933-a5ee8ebc5efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ec4297-7e8c-481d-b933-a5ee8ebc5efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1482d079-47c3-47f2-b573-2aa812741c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:42 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Volume 44bdb3c3-e2d9-41f5-afe4-e28745df26a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44bdb3c3-e2d9-41f5-afe4-e28745df26a8', 'volume_size': 1}
Nov 19 13:05:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:05:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:05:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1819464732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44bdb3c3-e2d9-41f5-afe4-e28745df26a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23bcf889e12344c199580bfb81aec013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:05:43Z,use_quota=True,user_id='6690079916344250bc4f3ec3f15f68a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:05:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Creating volume 44bdb3c3-e2d9-41f5-afe4-e28745df26a8 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:05:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:05:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:05:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:05:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:05:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:05:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:05:42 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:05:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-44bdb3c3-e2d9-41f5-afe4-e28745df26a8 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:05:43 devstack sudo[95182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-44bdb3c3-e2d9-41f5-afe4-e28745df26a8 1073741824
Nov 19 13:05:43 devstack sudo[95182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:05:43 devstack sudo[95182]: pam_unix(sudo:session): session closed for user root
Nov 19 13:05:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-44bdb3c3-e2d9-41f5-afe4-e28745df26a8 1073741824" returned: 0 in 0.762s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:05:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-44bdb3c3-e2d9-41f5-afe4-e28745df26a8 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:05:43 devstack sudo[95187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-44bdb3c3-e2d9-41f5-afe4-e28745df26a8
Nov 19 13:05:43 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:05:44 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root
Nov 19 13:05:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-44bdb3c3-e2d9-41f5-afe4-e28745df26a8" returned: 0 in 0.503s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:05:44 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:05:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:05:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1482d079-47c3-47f2-b573-2aa812741c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44bdb3c3-e2d9-41f5-afe4-e28745df26a8', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f803e7-ab7a-4a5e-a819-774d7ef18a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:44 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Volume volume-44bdb3c3-e2d9-41f5-afe4-e28745df26a8 (44bdb3c3-e2d9-41f5-afe4-e28745df26a8): created successfully
Nov 19 13:05:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f803e7-ab7a-4a5e-a819-774d7ef18a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Flow 'volume_create_manager' (926cc068-864b-44f1-a403-f90b2d489382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:05:44 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-6f6bac38-3ac5-4510-83a8-ba1be91e4031 tempest-VolumesActionsTest-1876506846 None] Created volume successfully.
Nov 19 13:05:45 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-214db413-a8ac-4d89-aacf-bd8044e69848 tempest-VolumesActionsTest-241571659 None] Acquiring lock "cinder-44bdb3c3-e2d9-41f5-afe4-e28745df26a8-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:05:45 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-214db413-a8ac-4d89-aacf-bd8044e69848 tempest-VolumesActionsTest-241571659 None] Lock "cinder-44bdb3c3-e2d9-41f5-afe4-e28745df26a8-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:05:45 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-214db413-a8ac-4d89-aacf-bd8044e69848 tempest-VolumesActionsTest-241571659 None] Acquiring lock "cinder-quobyte-44bdb3c3-e2d9-41f5-afe4-e28745df26a8" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:05:45 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-214db413-a8ac-4d89-aacf-bd8044e69848 tempest-VolumesActionsTest-241571659 None] Lock "cinder-quobyte-44bdb3c3-e2d9-41f5-afe4-e28745df26a8" acquired by "delete_volume" :: waited 0.040s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:05:45 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bf9531-bd5e-464d-822f-59cb15aa58f1]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:05:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-214db413-a8ac-4d89-aacf-bd8044e69848 tempest-VolumesActionsTest-241571659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-44bdb3c3-e2d9-41f5-afe4-e28745df26a8 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:05:45 devstack sudo[95190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-44bdb3c3-e2d9-41f5-afe4-e28745df26a8
Nov 19 13:05:45 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:05:45 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root
Nov 19 13:05:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-214db413-a8ac-4d89-aacf-bd8044e69848 tempest-VolumesActionsTest-241571659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-44bdb3c3-e2d9-41f5-afe4-e28745df26a8" returned: 0 in 0.609s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:05:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-214db413-a8ac-4d89-aacf-bd8044e69848 tempest-VolumesActionsTest-241571659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-44bdb3c3-e2d9-41f5-afe4-e28745df26a8 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:05:45 devstack sudo[95195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-44bdb3c3-e2d9-41f5-afe4-e28745df26a8
Nov 19 13:05:45 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:05:46 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root
Nov 19 13:05:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-214db413-a8ac-4d89-aacf-bd8044e69848 tempest-VolumesActionsTest-241571659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-44bdb3c3-e2d9-41f5-afe4-e28745df26a8" returned: 0 in 0.491s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:05:46 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-214db413-a8ac-4d89-aacf-bd8044e69848 tempest-VolumesActionsTest-241571659 None] Lock "cinder-quobyte-44bdb3c3-e2d9-41f5-afe4-e28745df26a8" released by "delete_volume" :: held 1.164s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:05:46 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-214db413-a8ac-4d89-aacf-bd8044e69848 tempest-VolumesActionsTest-241571659 None] Created reservations ['60d22c5d-161c-4187-83f6-8360579430b9', '11941c49-7108-44b4-8bc2-c2485071a397', 'c7d100d4-1f54-4843-9b9e-918f434563e2', 'bad00d58-fb6a-46a3-b176-3856c749ea6f'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:05:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-214db413-a8ac-4d89-aacf-bd8044e69848 tempest-VolumesActionsTest-241571659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:05:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-214db413-a8ac-4d89-aacf-bd8044e69848 tempest-VolumesActionsTest-241571659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:05:46 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-214db413-a8ac-4d89-aacf-bd8044e69848 tempest-VolumesActionsTest-241571659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:05:46 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-214db413-a8ac-4d89-aacf-bd8044e69848 tempest-VolumesActionsTest-241571659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:05:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-214db413-a8ac-4d89-aacf-bd8044e69848 tempest-VolumesActionsTest-241571659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:05:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-214db413-a8ac-4d89-aacf-bd8044e69848 tempest-VolumesActionsTest-241571659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:05:46 devstack sudo[95198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:05:46 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:05:46 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root
Nov 19 13:05:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-214db413-a8ac-4d89-aacf-bd8044e69848 tempest-VolumesActionsTest-241571659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.494s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:05:46 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-214db413-a8ac-4d89-aacf-bd8044e69848 tempest-VolumesActionsTest-241571659 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:05:46 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-214db413-a8ac-4d89-aacf-bd8044e69848 tempest-VolumesActionsTest-241571659 None] Deleted volume successfully.
Nov 19 13:05:46 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-214db413-a8ac-4d89-aacf-bd8044e69848 tempest-VolumesActionsTest-241571659 None] Lock "cinder-44bdb3c3-e2d9-41f5-afe4-e28745df26a8-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:05:47 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:05:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Flow 'volume_create_manager' (065b0742-40ed-4600-8c18-7bc54866f826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:05:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efce5327-d876-4475-9a2d-457012445395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efce5327-d876-4475-9a2d-457012445395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1272297701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e90a0206-a655-4831-b10d-eadbfe19c427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23bcf889e12344c199580bfb81aec013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:05:48Z,use_quota=True,user_id='6690079916344250bc4f3ec3f15f68a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f58b19-daaf-4934-9693-6edb4cb158e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f58b19-daaf-4934-9693-6edb4cb158e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21aa0fa-bb56-4acf-b810-5c1c4c683110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21aa0fa-bb56-4acf-b810-5c1c4c683110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e90a0206-a655-4831-b10d-eadbfe19c427', 'volume_name': 'volume-e90a0206-a655-4831-b10d-eadbfe19c427', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (386630ec-0367-49ea-bad1-1fb1c7853ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (386630ec-0367-49ea-bad1-1fb1c7853ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adcbb94f-f5d7-496f-95af-2ddd324704f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:47 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Volume e90a0206-a655-4831-b10d-eadbfe19c427: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e90a0206-a655-4831-b10d-eadbfe19c427', 'volume_size': 1}
Nov 19 13:05:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:05:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:05:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1272297701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e90a0206-a655-4831-b10d-eadbfe19c427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23bcf889e12344c199580bfb81aec013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:05:48Z,use_quota=True,user_id='6690079916344250bc4f3ec3f15f68a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:05:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Creating volume e90a0206-a655-4831-b10d-eadbfe19c427 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:05:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:05:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:05:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:05:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:05:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:05:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:05:47 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:05:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e90a0206-a655-4831-b10d-eadbfe19c427 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:05:47 devstack sudo[95201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e90a0206-a655-4831-b10d-eadbfe19c427 1073741824
Nov 19 13:05:47 devstack sudo[95201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:05:48 devstack sudo[95201]: pam_unix(sudo:session): session closed for user root
Nov 19 13:05:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e90a0206-a655-4831-b10d-eadbfe19c427 1073741824" returned: 0 in 0.554s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:05:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e90a0206-a655-4831-b10d-eadbfe19c427 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:05:48 devstack sudo[95206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e90a0206-a655-4831-b10d-eadbfe19c427
Nov 19 13:05:48 devstack sudo[95206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:05:48 devstack sudo[95206]: pam_unix(sudo:session): session closed for user root
Nov 19 13:05:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e90a0206-a655-4831-b10d-eadbfe19c427" returned: 0 in 0.521s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:05:48 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:05:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:05:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adcbb94f-f5d7-496f-95af-2ddd324704f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e90a0206-a655-4831-b10d-eadbfe19c427', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1590e076-a263-47c3-818c-9e81893a1333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:48 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Volume volume-e90a0206-a655-4831-b10d-eadbfe19c427 (e90a0206-a655-4831-b10d-eadbfe19c427): created successfully
Nov 19 13:05:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1590e076-a263-47c3-818c-9e81893a1333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Flow 'volume_create_manager' (065b0742-40ed-4600-8c18-7bc54866f826) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:05:48 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-ed78facd-2e7b-4bb9-848c-224601987541 tempest-VolumesActionsTest-1876506846 None] Created volume successfully.
Nov 19 13:05:49 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-7914d501-f10c-4771-9f3a-fc2fac138407 tempest-VolumesActionsTest-241571659 None] Acquiring lock "cinder-e90a0206-a655-4831-b10d-eadbfe19c427-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:05:49 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-7914d501-f10c-4771-9f3a-fc2fac138407 tempest-VolumesActionsTest-241571659 None] Lock "cinder-e90a0206-a655-4831-b10d-eadbfe19c427-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:05:49 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-7914d501-f10c-4771-9f3a-fc2fac138407 tempest-VolumesActionsTest-241571659 None] Acquiring lock "cinder-quobyte-e90a0206-a655-4831-b10d-eadbfe19c427" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:05:49 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-7914d501-f10c-4771-9f3a-fc2fac138407 tempest-VolumesActionsTest-241571659 None] Lock "cinder-quobyte-e90a0206-a655-4831-b10d-eadbfe19c427" acquired by "delete_volume" :: waited 0.012s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:05:49 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b0e355-5e66-4ef5-b04b-8f9b44dc4ddd]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:05:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7914d501-f10c-4771-9f3a-fc2fac138407 tempest-VolumesActionsTest-241571659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e90a0206-a655-4831-b10d-eadbfe19c427 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:05:50 devstack sudo[95209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e90a0206-a655-4831-b10d-eadbfe19c427
Nov 19 13:05:50 devstack sudo[95209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:05:50 devstack sudo[95209]: pam_unix(sudo:session): session closed for user root
Nov 19 13:05:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7914d501-f10c-4771-9f3a-fc2fac138407 tempest-VolumesActionsTest-241571659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e90a0206-a655-4831-b10d-eadbfe19c427" returned: 0 in 0.810s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:05:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7914d501-f10c-4771-9f3a-fc2fac138407 tempest-VolumesActionsTest-241571659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e90a0206-a655-4831-b10d-eadbfe19c427 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:05:50 devstack sudo[95214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e90a0206-a655-4831-b10d-eadbfe19c427
Nov 19 13:05:50 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:05:51 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root
Nov 19 13:05:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7914d501-f10c-4771-9f3a-fc2fac138407 tempest-VolumesActionsTest-241571659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e90a0206-a655-4831-b10d-eadbfe19c427" returned: 0 in 0.602s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:05:51 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-7914d501-f10c-4771-9f3a-fc2fac138407 tempest-VolumesActionsTest-241571659 None] Lock "cinder-quobyte-e90a0206-a655-4831-b10d-eadbfe19c427" released by "delete_volume" :: held 1.446s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:05:51 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-7914d501-f10c-4771-9f3a-fc2fac138407 tempest-VolumesActionsTest-241571659 None] Created reservations ['5cc6c664-098c-495f-985a-645b30d6e5f1', 'bb26a1cf-606d-4951-ab9b-b88e7fdd6417', 'df14d142-88f0-4e8e-9a0f-c1e828c817aa', 'f277893e-4f7a-4949-b96b-45f737640aa1'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:05:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7914d501-f10c-4771-9f3a-fc2fac138407 tempest-VolumesActionsTest-241571659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:05:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7914d501-f10c-4771-9f3a-fc2fac138407 tempest-VolumesActionsTest-241571659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:05:51 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7914d501-f10c-4771-9f3a-fc2fac138407 tempest-VolumesActionsTest-241571659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:05:51 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7914d501-f10c-4771-9f3a-fc2fac138407 tempest-VolumesActionsTest-241571659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:05:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7914d501-f10c-4771-9f3a-fc2fac138407 tempest-VolumesActionsTest-241571659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:05:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7914d501-f10c-4771-9f3a-fc2fac138407 tempest-VolumesActionsTest-241571659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:05:51 devstack sudo[95217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:05:51 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:05:52 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root
Nov 19 13:05:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7914d501-f10c-4771-9f3a-fc2fac138407 tempest-VolumesActionsTest-241571659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.593s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:05:52 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-7914d501-f10c-4771-9f3a-fc2fac138407 tempest-VolumesActionsTest-241571659 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:05:52 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-7914d501-f10c-4771-9f3a-fc2fac138407 tempest-VolumesActionsTest-241571659 None] Deleted volume successfully.
Nov 19 13:05:52 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-7914d501-f10c-4771-9f3a-fc2fac138407 tempest-VolumesActionsTest-241571659 None] Lock "cinder-e90a0206-a655-4831-b10d-eadbfe19c427-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:05:52 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:05:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Flow 'volume_create_manager' (cbbe1b37-2aac-4744-a77c-6d07796240ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:05:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4fcb091-79a7-4f23-a5bb-8e1818a6e44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4fcb091-79a7-4f23-a5bb-8e1818a6e44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1259257314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e243524d-8a77-4b76-8dc5-955c11d9dc6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23bcf889e12344c199580bfb81aec013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:05:52Z,use_quota=True,user_id='6690079916344250bc4f3ec3f15f68a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793ffefe-714b-43c7-98d2-ea44d9b5400b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793ffefe-714b-43c7-98d2-ea44d9b5400b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef5f0237-f6f1-4b70-bab8-d78f0b0893d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef5f0237-f6f1-4b70-bab8-d78f0b0893d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e243524d-8a77-4b76-8dc5-955c11d9dc6e', 'volume_name': 'volume-e243524d-8a77-4b76-8dc5-955c11d9dc6e', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbf2cd1-a8b3-42eb-b9d7-4fe44244e114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbf2cd1-a8b3-42eb-b9d7-4fe44244e114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd10fa0-6bb8-41cb-9340-4e98730b2ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:52 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Volume e243524d-8a77-4b76-8dc5-955c11d9dc6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e243524d-8a77-4b76-8dc5-955c11d9dc6e', 'volume_size': 1}
Nov 19 13:05:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:05:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:05:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1259257314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e243524d-8a77-4b76-8dc5-955c11d9dc6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23bcf889e12344c199580bfb81aec013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:05:52Z,use_quota=True,user_id='6690079916344250bc4f3ec3f15f68a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:05:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Creating volume e243524d-8a77-4b76-8dc5-955c11d9dc6e {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:05:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:05:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:05:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:05:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:05:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:05:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:05:52 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:05:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e243524d-8a77-4b76-8dc5-955c11d9dc6e 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:05:52 devstack sudo[95220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e243524d-8a77-4b76-8dc5-955c11d9dc6e 1073741824
Nov 19 13:05:52 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:05:53 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root
Nov 19 13:05:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e243524d-8a77-4b76-8dc5-955c11d9dc6e 1073741824" returned: 0 in 0.741s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:05:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e243524d-8a77-4b76-8dc5-955c11d9dc6e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:05:53 devstack sudo[95229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e243524d-8a77-4b76-8dc5-955c11d9dc6e
Nov 19 13:05:53 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:05:53 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root
Nov 19 13:05:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e243524d-8a77-4b76-8dc5-955c11d9dc6e" returned: 0 in 0.516s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:05:53 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:05:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:05:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd10fa0-6bb8-41cb-9340-4e98730b2ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e243524d-8a77-4b76-8dc5-955c11d9dc6e', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc760a47-8acf-4c64-bbbd-e84746f390bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:53 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Volume volume-e243524d-8a77-4b76-8dc5-955c11d9dc6e (e243524d-8a77-4b76-8dc5-955c11d9dc6e): created successfully
Nov 19 13:05:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc760a47-8acf-4c64-bbbd-e84746f390bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Flow 'volume_create_manager' (cbbe1b37-2aac-4744-a77c-6d07796240ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:05:53 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-e7619231-2adc-40c4-a74c-bb822f0bb6d8 tempest-VolumesActionsTest-1876506846 None] Created volume successfully.
Nov 19 13:05:54 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-01ff5471-e2ba-48fe-90f7-d4115c8a8e8a tempest-VolumesActionsTest-241571659 None] Acquiring lock "cinder-e243524d-8a77-4b76-8dc5-955c11d9dc6e-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:05:54 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-01ff5471-e2ba-48fe-90f7-d4115c8a8e8a tempest-VolumesActionsTest-241571659 None] Lock "cinder-e243524d-8a77-4b76-8dc5-955c11d9dc6e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:05:54 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-01ff5471-e2ba-48fe-90f7-d4115c8a8e8a tempest-VolumesActionsTest-241571659 None] Acquiring lock "cinder-quobyte-e243524d-8a77-4b76-8dc5-955c11d9dc6e" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:05:54 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-01ff5471-e2ba-48fe-90f7-d4115c8a8e8a tempest-VolumesActionsTest-241571659 None] Lock "cinder-quobyte-e243524d-8a77-4b76-8dc5-955c11d9dc6e" acquired by "delete_volume" :: waited 0.012s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:05:54 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[01436d53-651e-444a-82de-9d2467a192fc]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:05:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-01ff5471-e2ba-48fe-90f7-d4115c8a8e8a tempest-VolumesActionsTest-241571659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e243524d-8a77-4b76-8dc5-955c11d9dc6e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:05:54 devstack sudo[95232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e243524d-8a77-4b76-8dc5-955c11d9dc6e
Nov 19 13:05:54 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:05:55 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root
Nov 19 13:05:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-01ff5471-e2ba-48fe-90f7-d4115c8a8e8a tempest-VolumesActionsTest-241571659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e243524d-8a77-4b76-8dc5-955c11d9dc6e" returned: 0 in 0.707s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:05:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-01ff5471-e2ba-48fe-90f7-d4115c8a8e8a tempest-VolumesActionsTest-241571659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e243524d-8a77-4b76-8dc5-955c11d9dc6e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:05:55 devstack sudo[95239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e243524d-8a77-4b76-8dc5-955c11d9dc6e
Nov 19 13:05:55 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:05:56 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root
Nov 19 13:05:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-01ff5471-e2ba-48fe-90f7-d4115c8a8e8a tempest-VolumesActionsTest-241571659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e243524d-8a77-4b76-8dc5-955c11d9dc6e" returned: 0 in 0.585s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:05:56 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-01ff5471-e2ba-48fe-90f7-d4115c8a8e8a tempest-VolumesActionsTest-241571659 None] Lock "cinder-quobyte-e243524d-8a77-4b76-8dc5-955c11d9dc6e" released by "delete_volume" :: held 1.326s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:05:56 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-01ff5471-e2ba-48fe-90f7-d4115c8a8e8a tempest-VolumesActionsTest-241571659 None] Created reservations ['77ef7d98-0141-4b25-895d-068208acacb1', '8314b9ca-6c7c-41cb-9131-ee93e12f9912', '1ee194c2-50b8-435d-872f-a6c115eba5c4', '8a31ca5a-0b1c-4f40-ac4b-bfeb875dcda8'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:05:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-01ff5471-e2ba-48fe-90f7-d4115c8a8e8a tempest-VolumesActionsTest-241571659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:05:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-01ff5471-e2ba-48fe-90f7-d4115c8a8e8a tempest-VolumesActionsTest-241571659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:05:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-01ff5471-e2ba-48fe-90f7-d4115c8a8e8a tempest-VolumesActionsTest-241571659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:05:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-01ff5471-e2ba-48fe-90f7-d4115c8a8e8a tempest-VolumesActionsTest-241571659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:05:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-01ff5471-e2ba-48fe-90f7-d4115c8a8e8a tempest-VolumesActionsTest-241571659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:05:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-01ff5471-e2ba-48fe-90f7-d4115c8a8e8a tempest-VolumesActionsTest-241571659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:05:56 devstack sudo[95246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:05:56 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:05:56 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root
Nov 19 13:05:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-01ff5471-e2ba-48fe-90f7-d4115c8a8e8a tempest-VolumesActionsTest-241571659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.472s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:05:56 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-01ff5471-e2ba-48fe-90f7-d4115c8a8e8a tempest-VolumesActionsTest-241571659 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:05:56 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-01ff5471-e2ba-48fe-90f7-d4115c8a8e8a tempest-VolumesActionsTest-241571659 None] Deleted volume successfully.
Nov 19 13:05:56 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-01ff5471-e2ba-48fe-90f7-d4115c8a8e8a tempest-VolumesActionsTest-241571659 None] Lock "cinder-e243524d-8a77-4b76-8dc5-955c11d9dc6e-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:05:57 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:05:57 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Flow 'volume_create_manager' (88405691-baaf-41e7-a5fa-d30e05edf496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:05:57 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe86e5c-cbc8-44d3-8242-a2e51c8adbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:57 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe86e5c-cbc8-44d3-8242-a2e51c8adbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1831213376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad1f4a0-edec-4e0f-b099-34249aa4b20d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23bcf889e12344c199580bfb81aec013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:05:57Z,use_quota=True,user_id='6690079916344250bc4f3ec3f15f68a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:57 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (635c45e5-1992-4bdb-86e0-8ea3a7df777b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:57 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (635c45e5-1992-4bdb-86e0-8ea3a7df777b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:57 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f940d8b-0700-4b53-9368-4646224fb559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:57 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f940d8b-0700-4b53-9368-4646224fb559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ad1f4a0-edec-4e0f-b099-34249aa4b20d', 'volume_name': 'volume-8ad1f4a0-edec-4e0f-b099-34249aa4b20d', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:57 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c016fc56-8fbb-4757-9056-587b8fdca438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:57 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c016fc56-8fbb-4757-9056-587b8fdca438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:57 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590ca2c2-c798-4d2b-936a-b67840959268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:57 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Volume 8ad1f4a0-edec-4e0f-b099-34249aa4b20d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ad1f4a0-edec-4e0f-b099-34249aa4b20d', 'volume_size': 1}
Nov 19 13:05:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:05:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:05:57 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1831213376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad1f4a0-edec-4e0f-b099-34249aa4b20d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23bcf889e12344c199580bfb81aec013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:05:57Z,use_quota=True,user_id='6690079916344250bc4f3ec3f15f68a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:05:57 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Creating volume 8ad1f4a0-edec-4e0f-b099-34249aa4b20d {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:05:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:05:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:05:57 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:05:57 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:05:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:05:57 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:05:57 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:05:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8ad1f4a0-edec-4e0f-b099-34249aa4b20d 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:05:57 devstack sudo[95254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8ad1f4a0-edec-4e0f-b099-34249aa4b20d 1073741824
Nov 19 13:05:57 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:05:57 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root
Nov 19 13:05:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8ad1f4a0-edec-4e0f-b099-34249aa4b20d 1073741824" returned: 0 in 0.570s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:05:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8ad1f4a0-edec-4e0f-b099-34249aa4b20d {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:05:57 devstack sudo[95260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8ad1f4a0-edec-4e0f-b099-34249aa4b20d
Nov 19 13:05:57 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:05:58 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root
Nov 19 13:05:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8ad1f4a0-edec-4e0f-b099-34249aa4b20d" returned: 0 in 0.466s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:05:58 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:05:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:05:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590ca2c2-c798-4d2b-936a-b67840959268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ad1f4a0-edec-4e0f-b099-34249aa4b20d', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21dfdad-e1f7-41b5-b51d-1e7850173be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:05:58 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Volume volume-8ad1f4a0-edec-4e0f-b099-34249aa4b20d (8ad1f4a0-edec-4e0f-b099-34249aa4b20d): created successfully
Nov 19 13:05:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21dfdad-e1f7-41b5-b51d-1e7850173be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:05:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Flow 'volume_create_manager' (88405691-baaf-41e7-a5fa-d30e05edf496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:05:58 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-58702819-c4d6-406d-a8bc-8241e0a4245b tempest-VolumesActionsTest-1876506846 None] Created volume successfully.
Nov 19 13:05:59 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6d61dc09-dbf8-43f5-a170-d1821eb90cee tempest-VolumesActionsTest-241571659 None] Acquiring lock "cinder-8ad1f4a0-edec-4e0f-b099-34249aa4b20d-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:05:59 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6d61dc09-dbf8-43f5-a170-d1821eb90cee tempest-VolumesActionsTest-241571659 None] Lock "cinder-8ad1f4a0-edec-4e0f-b099-34249aa4b20d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:05:59 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6d61dc09-dbf8-43f5-a170-d1821eb90cee tempest-VolumesActionsTest-241571659 None] Acquiring lock "cinder-quobyte-8ad1f4a0-edec-4e0f-b099-34249aa4b20d" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:05:59 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6d61dc09-dbf8-43f5-a170-d1821eb90cee tempest-VolumesActionsTest-241571659 None] Lock "cinder-quobyte-8ad1f4a0-edec-4e0f-b099-34249aa4b20d" acquired by "delete_volume" :: waited 0.006s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:05:59 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd33f11b-f562-41c4-821b-62fb6738e4bc]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:05:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6d61dc09-dbf8-43f5-a170-d1821eb90cee tempest-VolumesActionsTest-241571659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8ad1f4a0-edec-4e0f-b099-34249aa4b20d {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:05:59 devstack sudo[95263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8ad1f4a0-edec-4e0f-b099-34249aa4b20d
Nov 19 13:05:59 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:00 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6d61dc09-dbf8-43f5-a170-d1821eb90cee tempest-VolumesActionsTest-241571659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8ad1f4a0-edec-4e0f-b099-34249aa4b20d" returned: 0 in 0.585s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6d61dc09-dbf8-43f5-a170-d1821eb90cee tempest-VolumesActionsTest-241571659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8ad1f4a0-edec-4e0f-b099-34249aa4b20d {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:00 devstack sudo[95268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8ad1f4a0-edec-4e0f-b099-34249aa4b20d
Nov 19 13:06:00 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:00 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6d61dc09-dbf8-43f5-a170-d1821eb90cee tempest-VolumesActionsTest-241571659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-8ad1f4a0-edec-4e0f-b099-34249aa4b20d" returned: 0 in 0.519s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:00 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6d61dc09-dbf8-43f5-a170-d1821eb90cee tempest-VolumesActionsTest-241571659 None] Lock "cinder-quobyte-8ad1f4a0-edec-4e0f-b099-34249aa4b20d" released by "delete_volume" :: held 1.129s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:06:00 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-6d61dc09-dbf8-43f5-a170-d1821eb90cee tempest-VolumesActionsTest-241571659 None] Created reservations ['03ee1b29-6ccb-4d41-b2a5-84d0e6762901', '6dc4915e-0d70-464a-9ddc-11260549dec1', '643292b9-4afc-448d-83bc-047bad39c8b9', '1dd2c54d-9b41-4488-af2e-dfe1479e4723'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:06:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6d61dc09-dbf8-43f5-a170-d1821eb90cee tempest-VolumesActionsTest-241571659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:06:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6d61dc09-dbf8-43f5-a170-d1821eb90cee tempest-VolumesActionsTest-241571659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:06:00 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6d61dc09-dbf8-43f5-a170-d1821eb90cee tempest-VolumesActionsTest-241571659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:06:00 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6d61dc09-dbf8-43f5-a170-d1821eb90cee tempest-VolumesActionsTest-241571659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:06:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6d61dc09-dbf8-43f5-a170-d1821eb90cee tempest-VolumesActionsTest-241571659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:06:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6d61dc09-dbf8-43f5-a170-d1821eb90cee tempest-VolumesActionsTest-241571659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:00 devstack sudo[95271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:06:00 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:01 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6d61dc09-dbf8-43f5-a170-d1821eb90cee tempest-VolumesActionsTest-241571659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.472s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:01 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-6d61dc09-dbf8-43f5-a170-d1821eb90cee tempest-VolumesActionsTest-241571659 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:06:01 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-6d61dc09-dbf8-43f5-a170-d1821eb90cee tempest-VolumesActionsTest-241571659 None] Deleted volume successfully.
Nov 19 13:06:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6d61dc09-dbf8-43f5-a170-d1821eb90cee tempest-VolumesActionsTest-241571659 None] Lock "cinder-8ad1f4a0-edec-4e0f-b099-34249aa4b20d-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:06:01 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:06:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Flow 'volume_create_manager' (eead1ea6-5dc9-4926-8f2d-5eaf1af8d9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:06:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04f03e7-596e-4f49-8bea-640ff7391a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04f03e7-596e-4f49-8bea-640ff7391a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1565903239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=528dba16-16e2-4ea1-ab2a-d54d20d11ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23bcf889e12344c199580bfb81aec013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:06:02Z,use_quota=True,user_id='6690079916344250bc4f3ec3f15f68a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aae859f6-ef37-4864-bdd9-1860afa0565a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aae859f6-ef37-4864-bdd9-1860afa0565a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6a10c05-ef27-4e6a-840e-5dd3aab6a05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6a10c05-ef27-4e6a-840e-5dd3aab6a05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '528dba16-16e2-4ea1-ab2a-d54d20d11ec3', 'volume_name': 'volume-528dba16-16e2-4ea1-ab2a-d54d20d11ec3', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b31bc22-97d4-400a-b5dc-b48721b9101a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b31bc22-97d4-400a-b5dc-b48721b9101a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a143785d-2401-4e95-afd5-6ce949562892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:01 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Volume 528dba16-16e2-4ea1-ab2a-d54d20d11ec3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-528dba16-16e2-4ea1-ab2a-d54d20d11ec3', 'volume_size': 1}
Nov 19 13:06:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:06:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:06:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1565903239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=528dba16-16e2-4ea1-ab2a-d54d20d11ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23bcf889e12344c199580bfb81aec013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:06:02Z,use_quota=True,user_id='6690079916344250bc4f3ec3f15f68a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:06:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Creating volume 528dba16-16e2-4ea1-ab2a-d54d20d11ec3 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:06:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:06:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:06:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:06:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:06:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:06:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:06:01 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:06:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-528dba16-16e2-4ea1-ab2a-d54d20d11ec3 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:01 devstack sudo[95279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-528dba16-16e2-4ea1-ab2a-d54d20d11ec3 1073741824
Nov 19 13:06:01 devstack sudo[95279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:02 devstack sudo[95279]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-528dba16-16e2-4ea1-ab2a-d54d20d11ec3 1073741824" returned: 0 in 0.666s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-528dba16-16e2-4ea1-ab2a-d54d20d11ec3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:02 devstack sudo[95295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-528dba16-16e2-4ea1-ab2a-d54d20d11ec3
Nov 19 13:06:02 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:03 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-528dba16-16e2-4ea1-ab2a-d54d20d11ec3" returned: 0 in 0.475s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:03 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:06:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:06:03 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a143785d-2401-4e95-afd5-6ce949562892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-528dba16-16e2-4ea1-ab2a-d54d20d11ec3', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:03 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb55f922-e6af-4c49-866e-bf9278ae6acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:03 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Volume volume-528dba16-16e2-4ea1-ab2a-d54d20d11ec3 (528dba16-16e2-4ea1-ab2a-d54d20d11ec3): created successfully
Nov 19 13:06:03 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb55f922-e6af-4c49-866e-bf9278ae6acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:03 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Flow 'volume_create_manager' (eead1ea6-5dc9-4926-8f2d-5eaf1af8d9fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:06:03 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-e05ff4a1-c2fb-44e2-9506-ceeb04329aa2 tempest-VolumesActionsTest-1876506846 None] Created volume successfully.
Nov 19 13:06:04 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-cf8efa85-30f5-4261-ae3c-6a78ddd04c67 tempest-VolumesActionsTest-1876506846 None] Acquiring lock "cinder-528dba16-16e2-4ea1-ab2a-d54d20d11ec3-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:06:04 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-cf8efa85-30f5-4261-ae3c-6a78ddd04c67 tempest-VolumesActionsTest-1876506846 None] Lock "cinder-528dba16-16e2-4ea1-ab2a-d54d20d11ec3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:06:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 13:06:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:06:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:06:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:06:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:06:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:06:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:04 devstack sudo[95302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:06:04 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:04 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-cf8efa85-30f5-4261-ae3c-6a78ddd04c67 tempest-VolumesActionsTest-1876506846 None] Acquiring lock "cinder-quobyte-528dba16-16e2-4ea1-ab2a-d54d20d11ec3" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:06:04 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-cf8efa85-30f5-4261-ae3c-6a78ddd04c67 tempest-VolumesActionsTest-1876506846 None] Lock "cinder-quobyte-528dba16-16e2-4ea1-ab2a-d54d20d11ec3" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:06:04 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed347d8-0bd7-46ea-8381-9561a1679ef9]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:06:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cf8efa85-30f5-4261-ae3c-6a78ddd04c67 tempest-VolumesActionsTest-1876506846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-528dba16-16e2-4ea1-ab2a-d54d20d11ec3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:04 devstack sudo[95304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-528dba16-16e2-4ea1-ab2a-d54d20d11ec3
Nov 19 13:06:04 devstack sudo[95304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:05 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.502s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:05 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:06:05 devstack sudo[95304]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cf8efa85-30f5-4261-ae3c-6a78ddd04c67 tempest-VolumesActionsTest-1876506846 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-528dba16-16e2-4ea1-ab2a-d54d20d11ec3" returned: 0 in 0.560s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cf8efa85-30f5-4261-ae3c-6a78ddd04c67 tempest-VolumesActionsTest-1876506846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-528dba16-16e2-4ea1-ab2a-d54d20d11ec3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:05 devstack sudo[95310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-528dba16-16e2-4ea1-ab2a-d54d20d11ec3
Nov 19 13:06:05 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:05 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cf8efa85-30f5-4261-ae3c-6a78ddd04c67 tempest-VolumesActionsTest-1876506846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-528dba16-16e2-4ea1-ab2a-d54d20d11ec3" returned: 0 in 0.488s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:05 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-cf8efa85-30f5-4261-ae3c-6a78ddd04c67 tempest-VolumesActionsTest-1876506846 None] Lock "cinder-quobyte-528dba16-16e2-4ea1-ab2a-d54d20d11ec3" released by "delete_volume" :: held 1.101s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:06:05 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-cf8efa85-30f5-4261-ae3c-6a78ddd04c67 tempest-VolumesActionsTest-1876506846 None] Created reservations ['e2c57c6b-1fc9-4681-a74b-e06519436147', 'c98eb725-20f6-415b-a391-dbce93d0d4c3', '4c5b6c52-affd-4e68-89ad-08afc91adea9', 'aa9cfbee-df1d-4279-a9e2-949a3d0a041c'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:06:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cf8efa85-30f5-4261-ae3c-6a78ddd04c67 tempest-VolumesActionsTest-1876506846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:06:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cf8efa85-30f5-4261-ae3c-6a78ddd04c67 tempest-VolumesActionsTest-1876506846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:06:05 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-cf8efa85-30f5-4261-ae3c-6a78ddd04c67 tempest-VolumesActionsTest-1876506846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:06:05 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-cf8efa85-30f5-4261-ae3c-6a78ddd04c67 tempest-VolumesActionsTest-1876506846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:06:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cf8efa85-30f5-4261-ae3c-6a78ddd04c67 tempest-VolumesActionsTest-1876506846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:06:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cf8efa85-30f5-4261-ae3c-6a78ddd04c67 tempest-VolumesActionsTest-1876506846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:05 devstack sudo[95313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:06:05 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:06 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cf8efa85-30f5-4261-ae3c-6a78ddd04c67 tempest-VolumesActionsTest-1876506846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.624s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:06 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-cf8efa85-30f5-4261-ae3c-6a78ddd04c67 tempest-VolumesActionsTest-1876506846 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:06:06 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-cf8efa85-30f5-4261-ae3c-6a78ddd04c67 tempest-VolumesActionsTest-1876506846 None] Deleted volume successfully.
Nov 19 13:06:06 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-cf8efa85-30f5-4261-ae3c-6a78ddd04c67 tempest-VolumesActionsTest-1876506846 None] Lock "cinder-528dba16-16e2-4ea1-ab2a-d54d20d11ec3-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:06:15 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=54,cinder:INSERT=12,cinder:UPDATE=73,cinder:DELETE=7 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:06:16 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=46,cinder:UPDATE=71,cinder:INSERT=18,cinder:DELETE=6 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:06:16 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:06:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Flow 'volume_create_manager' (9a3eb8a0-221e-4079-a531-a8056098907b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:06:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c60aeed-2843-489f-8146-2325b0203d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c60aeed-2843-489f-8146-2325b0203d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-368246256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c25d854-8d90-4e51-9d45-cad0571e56ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75a97fc8ea946aab1bf53fdff1275b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:06:17Z,use_quota=True,user_id='32e83bf64dee4ecba01fc7e1394a81ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7856eb6-9355-4a7f-a60a-3f97710a03d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7856eb6-9355-4a7f-a60a-3f97710a03d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad848282-a9b4-4c5f-9c00-d962be25098e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:16 devstack cinder-volume[80839]: DEBUG cinder.image.glance [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Creating Keystone auth plugin from conf {{(pid=80839) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Nov 19 13:06:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad848282-a9b4-4c5f-9c00-d962be25098e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6c25d854-8d90-4e51-9d45-cad0571e56ef', 'volume_name': 'volume-6c25d854-8d90-4e51-9d45-cad0571e56ef', 'volume_size': 1, 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb13a00dd9444268988d63a8279e0575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5d491c17-c417-4a2b-886e-ad2958917626', 'created_at': datetime.datetime(2025, 11, 19, 11, 46, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 19, 11, 46, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d491c17-c417-4a2b-886e-ad2958917626/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbd13a53f70>}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e1301c-ea7d-4744-b30d-f17c7d7c057d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e1301c-ea7d-4744-b30d-f17c7d7c057d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c7c5cb-8b3c-44ce-95be-e5554b564ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:17 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Volume 6c25d854-8d90-4e51-9d45-cad0571e56ef: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6c25d854-8d90-4e51-9d45-cad0571e56ef', 'volume_size': 1, 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb13a00dd9444268988d63a8279e0575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5d491c17-c417-4a2b-886e-ad2958917626', 'created_at': datetime.datetime(2025, 11, 19, 11, 46, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 19, 11, 46, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d491c17-c417-4a2b-886e-ad2958917626/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbd13a53f70>}
Nov 19 13:06:17 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Cloning 6c25d854-8d90-4e51-9d45-cad0571e56ef from image 5d491c17-c417-4a2b-886e-ad2958917626  at location (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]). {{(pid=80839) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Nov 19 13:06:17 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_xnvo3_jydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=80839) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Nov 19 13:06:17 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Image download 20.69 MB at 20.69 MB/s
Nov 19 13:06:17 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f24437-75e0-4b65-a2a9-1dc74c21946a]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:06:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_xnvo3_jydevstack@QuobyteHD {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:17 devstack sudo[95399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_xnvo3_jydevstack@QuobyteHD
Nov 19 13:06:17 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:17 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_xnvo3_jydevstack@QuobyteHD" returned: 0 in 0.578s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:17 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Temporary image 5d491c17-c417-4a2b-886e-ad2958917626 is fetched for user 32e83bf64dee4ecba01fc7e1394a81ca. {{(pid=80839) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Nov 19 13:06:18 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[669bd787-2090-43c9-8ef0-31a5acf26868]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:06:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_xnvo3_jydevstack@QuobyteHD {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:18 devstack sudo[95405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_xnvo3_jydevstack@QuobyteHD
Nov 19 13:06:18 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:18 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_xnvo3_jydevstack@QuobyteHD" returned: 0 in 0.554s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:06:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:06:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-368246256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c25d854-8d90-4e51-9d45-cad0571e56ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75a97fc8ea946aab1bf53fdff1275b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:06:17Z,use_quota=True,user_id='32e83bf64dee4ecba01fc7e1394a81ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:06:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Creating volume 6c25d854-8d90-4e51-9d45-cad0571e56ef {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:06:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:06:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:06:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:06:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:06:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:06:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:06:18 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:06:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:18 devstack sudo[95410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef 1073741824
Nov 19 13:06:18 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:19 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef 1073741824" returned: 0 in 0.594s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:19 devstack sudo[95415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef
Nov 19 13:06:19 devstack sudo[95415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:19 devstack sudo[95415]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef" returned: 0 in 0.458s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:19 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:06:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:06:19 devstack cinder-volume[80839]: DEBUG cinder.volume.volume_utils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Attempting download of 5d491c17-c417-4a2b-886e-ad2958917626 ((None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}])) to volume 6c25d854-8d90-4e51-9d45-cad0571e56ef. {{(pid=80839) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Nov 19 13:06:19 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff146104-96c0-44cf-94c5-f45ed6bdd8ba]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:06:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_g4qc_74t {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:19 devstack sudo[95418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_g4qc_74t
Nov 19 13:06:19 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:20 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_g4qc_74t" returned: 0 in 0.541s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_g4qc_74t {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:20 devstack sudo[95422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_g4qc_74t
Nov 19 13:06:20 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:20 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_g4qc_74t" returned: 1 in 0.521s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_g4qc_74t' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 13:06:20 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[431b54d0-f9d7-4a53-823b-71d6db01ea70]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:06:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_xnvo3_jydevstack@QuobyteHD {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:20 devstack sudo[95426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_xnvo3_jydevstack@QuobyteHD
Nov 19 13:06:20 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:21 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_xnvo3_jydevstack@QuobyteHD" returned: 0 in 0.547s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:21 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] 5d491c17-c417-4a2b-886e-ad2958917626 was qcow2, converting to raw {{(pid=80839) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Nov 19 13:06:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_xnvo3_jydevstack@QuobyteHD /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:21 devstack sudo[95431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_xnvo3_jydevstack@QuobyteHD /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef
Nov 19 13:06:21 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:22 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_xnvo3_jydevstack@QuobyteHD /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef" returned: 0 in 0.977s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:22 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_xnvo3_jydevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef {{(pid=80839) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 19 13:06:22 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Converted 112.00 MB image at 112.00 MB/s
Nov 19 13:06:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:22 devstack sudo[95449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef 1G
Nov 19 13:06:22 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:22 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef 1G" returned: 0 in 0.490s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:22 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99b6639-f01a-4909-b56d-457a06601fba]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:06:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:22 devstack sudo[95455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef
Nov 19 13:06:22 devstack sudo[95455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:23 devstack sudo[95455]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef" returned: 0 in 0.563s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:23 devstack sudo[95459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef
Nov 19 13:06:23 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:23 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef" returned: 1 in 0.574s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 13:06:23 devstack cinder-volume[80839]: DEBUG cinder.volume.volume_utils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Downloaded image 5d491c17-c417-4a2b-886e-ad2958917626 ((None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}])) to volume 6c25d854-8d90-4e51-9d45-cad0571e56ef successfully. {{(pid=80839) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Nov 19 13:06:23 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Temporary image 5d491c17-c417-4a2b-886e-ad2958917626 for user 32e83bf64dee4ecba01fc7e1394a81ca is deleted. {{(pid=80839) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Nov 19 13:06:23 devstack cinder-volume[80839]: DEBUG cinder.volume.volume_utils [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Marking volume 6c25d854-8d90-4e51-9d45-cad0571e56ef as bootable. {{(pid=80839) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Nov 19 13:06:23 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Copying metadata from image 5d491c17-c417-4a2b-886e-ad2958917626 to 6c25d854-8d90-4e51-9d45-cad0571e56ef. {{(pid=80839) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 19 13:06:23 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Creating volume glance metadata for volume 6c25d854-8d90-4e51-9d45-cad0571e56ef backed by image 5d491c17-c417-4a2b-886e-ad2958917626 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=80839) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 19 13:06:24 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c7c5cb-8b3c-44ce-95be-e5554b564ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c25d854-8d90-4e51-9d45-cad0571e56ef', 'volume_size': 1, 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb13a00dd9444268988d63a8279e0575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5d491c17-c417-4a2b-886e-ad2958917626', 'created_at': datetime.datetime(2025, 11, 19, 11, 46, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 19, 11, 46, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d491c17-c417-4a2b-886e-ad2958917626/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbd13a53f70>}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:24 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0275ae04-e02f-467d-9abf-3e8b5a794ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:24 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Volume volume-6c25d854-8d90-4e51-9d45-cad0571e56ef (6c25d854-8d90-4e51-9d45-cad0571e56ef): created successfully
Nov 19 13:06:24 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0275ae04-e02f-467d-9abf-3e8b5a794ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:24 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Flow 'volume_create_manager' (9a3eb8a0-221e-4079-a531-a8056098907b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:06:24 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-0da795cd-02ad-4882-abb8-7ce58cabf7cd tempest-VolumesImageMetadata-1580711249 None] Created volume successfully.
Nov 19 13:06:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8581f48e-0509-4d7d-9f1c-212ec4f920e9 tempest-VolumesImageMetadata-1580711249 None] Acquiring lock "cinder-6c25d854-8d90-4e51-9d45-cad0571e56ef-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:06:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8581f48e-0509-4d7d-9f1c-212ec4f920e9 tempest-VolumesImageMetadata-1580711249 None] Lock "cinder-6c25d854-8d90-4e51-9d45-cad0571e56ef-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:06:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8581f48e-0509-4d7d-9f1c-212ec4f920e9 tempest-VolumesImageMetadata-1580711249 None] Acquiring lock "cinder-quobyte-6c25d854-8d90-4e51-9d45-cad0571e56ef" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:06:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8581f48e-0509-4d7d-9f1c-212ec4f920e9 tempest-VolumesImageMetadata-1580711249 None] Lock "cinder-quobyte-6c25d854-8d90-4e51-9d45-cad0571e56ef" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:06:24 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15ffb3e-2812-4869-a137-e47f019cdc3b]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:06:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8581f48e-0509-4d7d-9f1c-212ec4f920e9 tempest-VolumesImageMetadata-1580711249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:24 devstack sudo[95464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef
Nov 19 13:06:24 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:25 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8581f48e-0509-4d7d-9f1c-212ec4f920e9 tempest-VolumesImageMetadata-1580711249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef" returned: 0 in 0.552s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8581f48e-0509-4d7d-9f1c-212ec4f920e9 tempest-VolumesImageMetadata-1580711249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:25 devstack sudo[95469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef
Nov 19 13:06:25 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:25 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8581f48e-0509-4d7d-9f1c-212ec4f920e9 tempest-VolumesImageMetadata-1580711249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef" returned: 1 in 0.577s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8581f48e-0509-4d7d-9f1c-212ec4f920e9 tempest-VolumesImageMetadata-1580711249 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 13:06:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8581f48e-0509-4d7d-9f1c-212ec4f920e9 tempest-VolumesImageMetadata-1580711249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:25 devstack sudo[95474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef
Nov 19 13:06:25 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:26 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8581f48e-0509-4d7d-9f1c-212ec4f920e9 tempest-VolumesImageMetadata-1580711249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-6c25d854-8d90-4e51-9d45-cad0571e56ef" returned: 0 in 0.465s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8581f48e-0509-4d7d-9f1c-212ec4f920e9 tempest-VolumesImageMetadata-1580711249 None] Lock "cinder-quobyte-6c25d854-8d90-4e51-9d45-cad0571e56ef" released by "delete_volume" :: held 1.657s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:06:26 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-8581f48e-0509-4d7d-9f1c-212ec4f920e9 tempest-VolumesImageMetadata-1580711249 None] Created reservations ['13bda374-8396-4b59-8a0e-88cffe304b1e', 'e8c0ca59-d0c8-406e-860d-328d1ba60b6d', '0be69440-c299-4741-9a6f-30f445474c3a', 'ad776c22-967a-426c-ba81-3334d84665a8'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:06:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8581f48e-0509-4d7d-9f1c-212ec4f920e9 tempest-VolumesImageMetadata-1580711249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:06:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8581f48e-0509-4d7d-9f1c-212ec4f920e9 tempest-VolumesImageMetadata-1580711249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:06:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8581f48e-0509-4d7d-9f1c-212ec4f920e9 tempest-VolumesImageMetadata-1580711249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:06:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8581f48e-0509-4d7d-9f1c-212ec4f920e9 tempest-VolumesImageMetadata-1580711249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:06:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8581f48e-0509-4d7d-9f1c-212ec4f920e9 tempest-VolumesImageMetadata-1580711249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:06:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8581f48e-0509-4d7d-9f1c-212ec4f920e9 tempest-VolumesImageMetadata-1580711249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:26 devstack sudo[95477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:06:26 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:26 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8581f48e-0509-4d7d-9f1c-212ec4f920e9 tempest-VolumesImageMetadata-1580711249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.517s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:26 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-8581f48e-0509-4d7d-9f1c-212ec4f920e9 tempest-VolumesImageMetadata-1580711249 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:06:26 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-8581f48e-0509-4d7d-9f1c-212ec4f920e9 tempest-VolumesImageMetadata-1580711249 None] Deleted volume successfully.
Nov 19 13:06:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8581f48e-0509-4d7d-9f1c-212ec4f920e9 tempest-VolumesImageMetadata-1580711249 None] Lock "cinder-6c25d854-8d90-4e51-9d45-cad0571e56ef-delete_volume" released by "delete_volume" :: held 2.315s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:06:28 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:06:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Flow 'volume_create_manager' (fdd46247-c936-4ce4-895b-e3572e54ac5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:06:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1fea7ec-63c2-4659-bc98-588728b133a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1fea7ec-63c2-4659-bc98-588728b133a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1866000129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a1a2442-f1f2-41ce-bfb9-cd0bc739157b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93ab23c28294ce99b1b203b8e454b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:06:29Z,use_quota=True,user_id='7f655c2811b140828f55fba684a3da79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57e03328-84f7-49d9-a7ea-8ef03bec7220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57e03328-84f7-49d9-a7ea-8ef03bec7220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de3d2572-d734-4dfe-8a90-8484432c53a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de3d2572-d734-4dfe-8a90-8484432c53a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a1a2442-f1f2-41ce-bfb9-cd0bc739157b', 'volume_name': 'volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd6ca49-cb39-47e3-bb5a-6c4e6fdfc2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd6ca49-cb39-47e3-bb5a-6c4e6fdfc2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78e9fe16-ded3-427e-9736-c3709e95b901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:28 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Volume 1a1a2442-f1f2-41ce-bfb9-cd0bc739157b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b', 'volume_size': 1}
Nov 19 13:06:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:06:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:06:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1866000129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a1a2442-f1f2-41ce-bfb9-cd0bc739157b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93ab23c28294ce99b1b203b8e454b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:06:29Z,use_quota=True,user_id='7f655c2811b140828f55fba684a3da79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:06:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Creating volume 1a1a2442-f1f2-41ce-bfb9-cd0bc739157b {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:06:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:06:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:06:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:06:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:06:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:06:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:06:28 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:06:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:28 devstack sudo[95483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b 1073741824
Nov 19 13:06:28 devstack sudo[95483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:29 devstack sudo[95483]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b 1073741824" returned: 0 in 0.528s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:29 devstack sudo[95492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b
Nov 19 13:06:29 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:29 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b" returned: 0 in 0.451s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:29 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:06:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:06:29 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78e9fe16-ded3-427e-9736-c3709e95b901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:29 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b356d7f1-3e9f-48bb-affd-3181f95b0089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:29 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Volume volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b (1a1a2442-f1f2-41ce-bfb9-cd0bc739157b): created successfully
Nov 19 13:06:29 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b356d7f1-3e9f-48bb-affd-3181f95b0089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:29 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Flow 'volume_create_manager' (fdd46247-c936-4ce4-895b-e3572e54ac5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:06:29 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-f412e732-49bf-4d5e-be2c-e72067ae05ff tempest-SnapshotMetadataTestJSON-1994294245 None] Created volume successfully.
Nov 19 13:06:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-95b986e8-ae76-4824-af41-1776d1899a83 tempest-SnapshotMetadataTestJSON-1994294245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:06:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-95b986e8-ae76-4824-af41-1776d1899a83 tempest-SnapshotMetadataTestJSON-1994294245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:06:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-95b986e8-ae76-4824-af41-1776d1899a83 tempest-SnapshotMetadataTestJSON-1994294245 None] Creating offline snapshot 03ae6850-9b86-4fae-99b2-aa17f011bf83 of volume 1a1a2442-f1f2-41ce-bfb9-cd0bc739157b {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 13:06:30 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc6f820-8140-4d0d-b510-f158a669f587]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:06:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-95b986e8-ae76-4824-af41-1776d1899a83 tempest-SnapshotMetadataTestJSON-1994294245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:30 devstack sudo[95496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b
Nov 19 13:06:30 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:31 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-95b986e8-ae76-4824-af41-1776d1899a83 tempest-SnapshotMetadataTestJSON-1994294245 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b" returned: 0 in 0.541s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-95b986e8-ae76-4824-af41-1776d1899a83 tempest-SnapshotMetadataTestJSON-1994294245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b.03ae6850-9b86-4fae-99b2-aa17f011bf83 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:31 devstack sudo[95501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b.03ae6850-9b86-4fae-99b2-aa17f011bf83 1G
Nov 19 13:06:31 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:31 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-95b986e8-ae76-4824-af41-1776d1899a83 tempest-SnapshotMetadataTestJSON-1994294245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b.03ae6850-9b86-4fae-99b2-aa17f011bf83 1G" returned: 0 in 0.551s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-95b986e8-ae76-4824-af41-1776d1899a83 tempest-SnapshotMetadataTestJSON-1994294245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b.03ae6850-9b86-4fae-99b2-aa17f011bf83 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:31 devstack sudo[95506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b.03ae6850-9b86-4fae-99b2-aa17f011bf83
Nov 19 13:06:31 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:32 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-95b986e8-ae76-4824-af41-1776d1899a83 tempest-SnapshotMetadataTestJSON-1994294245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b.03ae6850-9b86-4fae-99b2-aa17f011bf83" returned: 0 in 0.457s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:32 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-95b986e8-ae76-4824-af41-1776d1899a83 tempest-SnapshotMetadataTestJSON-1994294245 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b.03ae6850-9b86-4fae-99b2-aa17f011bf83 is being set with open permissions: ugo+rw
Nov 19 13:06:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-95b986e8-ae76-4824-af41-1776d1899a83 tempest-SnapshotMetadataTestJSON-1994294245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b.03ae6850-9b86-4fae-99b2-aa17f011bf83 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:32 devstack sudo[95511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b.03ae6850-9b86-4fae-99b2-aa17f011bf83
Nov 19 13:06:32 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:32 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-95b986e8-ae76-4824-af41-1776d1899a83 tempest-SnapshotMetadataTestJSON-1994294245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b.03ae6850-9b86-4fae-99b2-aa17f011bf83" returned: 0 in 0.482s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-95b986e8-ae76-4824-af41-1776d1899a83 tempest-SnapshotMetadataTestJSON-1994294245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:32 devstack sudo[95515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b.info
Nov 19 13:06:32 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:33 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-95b986e8-ae76-4824-af41-1776d1899a83 tempest-SnapshotMetadataTestJSON-1994294245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b.info" returned: 0 in 0.465s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:33 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-95b986e8-ae76-4824-af41-1776d1899a83 tempest-SnapshotMetadataTestJSON-1994294245 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b.info is being set with open permissions: ugo+rw
Nov 19 13:06:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-95b986e8-ae76-4824-af41-1776d1899a83 tempest-SnapshotMetadataTestJSON-1994294245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:33 devstack sudo[95518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b.info
Nov 19 13:06:33 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:33 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-95b986e8-ae76-4824-af41-1776d1899a83 tempest-SnapshotMetadataTestJSON-1994294245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b.info" returned: 0 in 0.471s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-95b986e8-ae76-4824-af41-1776d1899a83 tempest-SnapshotMetadataTestJSON-1994294245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.009s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:06:33 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-95b986e8-ae76-4824-af41-1776d1899a83 tempest-SnapshotMetadataTestJSON-1994294245 None] Create snapshot completed successfully
Nov 19 13:06:34 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9501c057-39d6-4f33-9c26-5c895aff46a5 tempest-SnapshotMetadataTestJSON-1994294245 None] Acquiring lock "cinder-03ae6850-9b86-4fae-99b2-aa17f011bf83-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:06:34 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9501c057-39d6-4f33-9c26-5c895aff46a5 tempest-SnapshotMetadataTestJSON-1994294245 None] Lock "cinder-03ae6850-9b86-4fae-99b2-aa17f011bf83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:06:34 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9501c057-39d6-4f33-9c26-5c895aff46a5 tempest-SnapshotMetadataTestJSON-1994294245 None] Acquiring lock "cinder-quobyte-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:06:34 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9501c057-39d6-4f33-9c26-5c895aff46a5 tempest-SnapshotMetadataTestJSON-1994294245 None] Lock "cinder-quobyte-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b" acquired by "delete_snapshot" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:06:34 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9501c057-39d6-4f33-9c26-5c895aff46a5 tempest-SnapshotMetadataTestJSON-1994294245 None] Acquiring lock "cinder-quobyte-03ae6850-9b86-4fae-99b2-aa17f011bf83" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:06:34 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9501c057-39d6-4f33-9c26-5c895aff46a5 tempest-SnapshotMetadataTestJSON-1994294245 None] Lock "cinder-quobyte-03ae6850-9b86-4fae-99b2-aa17f011bf83" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:06:34 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-9501c057-39d6-4f33-9c26-5c895aff46a5 tempest-SnapshotMetadataTestJSON-1994294245 None] Deleting offline snapshot 03ae6850-9b86-4fae-99b2-aa17f011bf83 of volume 1a1a2442-f1f2-41ce-bfb9-cd0bc739157b {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 13:06:34 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-9501c057-39d6-4f33-9c26-5c895aff46a5 tempest-SnapshotMetadataTestJSON-1994294245 None] snapshot_file for this snap is: volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b.03ae6850-9b86-4fae-99b2-aa17f011bf83 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 13:06:34 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c492c8-cc31-4b7c-88be-b70110b15036]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:06:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9501c057-39d6-4f33-9c26-5c895aff46a5 tempest-SnapshotMetadataTestJSON-1994294245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b.03ae6850-9b86-4fae-99b2-aa17f011bf83 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:34 devstack sudo[95566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b.03ae6850-9b86-4fae-99b2-aa17f011bf83
Nov 19 13:06:34 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:35 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9501c057-39d6-4f33-9c26-5c895aff46a5 tempest-SnapshotMetadataTestJSON-1994294245 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b.03ae6850-9b86-4fae-99b2-aa17f011bf83" returned: 0 in 0.559s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:35 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-9501c057-39d6-4f33-9c26-5c895aff46a5 tempest-SnapshotMetadataTestJSON-1994294245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:06:35 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a74cab6-fe3f-4a77-b9e9-1509eb02526e]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:06:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9501c057-39d6-4f33-9c26-5c895aff46a5 tempest-SnapshotMetadataTestJSON-1994294245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:35 devstack sudo[95573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b
Nov 19 13:06:35 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:35 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9501c057-39d6-4f33-9c26-5c895aff46a5 tempest-SnapshotMetadataTestJSON-1994294245 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b" returned: 0 in 0.565s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9501c057-39d6-4f33-9c26-5c895aff46a5 tempest-SnapshotMetadataTestJSON-1994294245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b.03ae6850-9b86-4fae-99b2-aa17f011bf83 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:35 devstack sudo[95584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b.03ae6850-9b86-4fae-99b2-aa17f011bf83
Nov 19 13:06:35 devstack sudo[95584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:36 devstack sudo[95584]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9501c057-39d6-4f33-9c26-5c895aff46a5 tempest-SnapshotMetadataTestJSON-1994294245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b.03ae6850-9b86-4fae-99b2-aa17f011bf83" returned: 0 in 0.513s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9501c057-39d6-4f33-9c26-5c895aff46a5 tempest-SnapshotMetadataTestJSON-1994294245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b.03ae6850-9b86-4fae-99b2-aa17f011bf83 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:36 devstack sudo[95589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b.03ae6850-9b86-4fae-99b2-aa17f011bf83
Nov 19 13:06:36 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:36 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9501c057-39d6-4f33-9c26-5c895aff46a5 tempest-SnapshotMetadataTestJSON-1994294245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b.03ae6850-9b86-4fae-99b2-aa17f011bf83" returned: 0 in 0.446s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:36 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9501c057-39d6-4f33-9c26-5c895aff46a5 tempest-SnapshotMetadataTestJSON-1994294245 None] Lock "cinder-quobyte-03ae6850-9b86-4fae-99b2-aa17f011bf83" released by "_delete_snapshot" :: held 2.165s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:06:36 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9501c057-39d6-4f33-9c26-5c895aff46a5 tempest-SnapshotMetadataTestJSON-1994294245 None] Lock "cinder-quobyte-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b" released by "delete_snapshot" :: held 2.177s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:06:36 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-9501c057-39d6-4f33-9c26-5c895aff46a5 tempest-SnapshotMetadataTestJSON-1994294245 None] Created reservations ['1607a6f0-b9ef-4b09-bdc8-893e26d69d94', 'eef4209c-529f-403d-9a3f-0373af3af40b', '1966d7ba-4509-4eee-a462-3761322086bb', '257174fb-6835-469e-85ee-ff26026435ea'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:06:36 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-9501c057-39d6-4f33-9c26-5c895aff46a5 tempest-SnapshotMetadataTestJSON-1994294245 None] Delete snapshot completed successfully.
Nov 19 13:06:36 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9501c057-39d6-4f33-9c26-5c895aff46a5 tempest-SnapshotMetadataTestJSON-1994294245 None] Lock "cinder-03ae6850-9b86-4fae-99b2-aa17f011bf83-delete_snapshot" released by "delete_snapshot" :: held 2.267s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:06:37 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-1319ff45-46b0-48fa-9ae7-9f200f1ffdc8 tempest-SnapshotMetadataTestJSON-1994294245 None] Acquiring lock "cinder-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:06:37 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-1319ff45-46b0-48fa-9ae7-9f200f1ffdc8 tempest-SnapshotMetadataTestJSON-1994294245 None] Lock "cinder-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:06:37 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-1319ff45-46b0-48fa-9ae7-9f200f1ffdc8 tempest-SnapshotMetadataTestJSON-1994294245 None] Acquiring lock "cinder-quobyte-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:06:37 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-1319ff45-46b0-48fa-9ae7-9f200f1ffdc8 tempest-SnapshotMetadataTestJSON-1994294245 None] Lock "cinder-quobyte-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:06:37 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e201e94-6d03-46a6-8a19-0f0480d67ba1]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:06:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1319ff45-46b0-48fa-9ae7-9f200f1ffdc8 tempest-SnapshotMetadataTestJSON-1994294245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:37 devstack sudo[95593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b
Nov 19 13:06:37 devstack sudo[95593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:38 devstack sudo[95593]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1319ff45-46b0-48fa-9ae7-9f200f1ffdc8 tempest-SnapshotMetadataTestJSON-1994294245 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b" returned: 0 in 0.546s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1319ff45-46b0-48fa-9ae7-9f200f1ffdc8 tempest-SnapshotMetadataTestJSON-1994294245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:38 devstack sudo[95598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b
Nov 19 13:06:38 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:38 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1319ff45-46b0-48fa-9ae7-9f200f1ffdc8 tempest-SnapshotMetadataTestJSON-1994294245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b" returned: 0 in 0.458s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:38 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-1319ff45-46b0-48fa-9ae7-9f200f1ffdc8 tempest-SnapshotMetadataTestJSON-1994294245 None] Lock "cinder-quobyte-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b" released by "delete_volume" :: held 1.066s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:06:38 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-1319ff45-46b0-48fa-9ae7-9f200f1ffdc8 tempest-SnapshotMetadataTestJSON-1994294245 None] Created reservations ['99b17eff-393a-4158-9bca-7bb66fb32ff2', 'e7da8728-7b95-4bd5-a0f9-aefe4fca9a63', 'fbd54e3a-a75a-4291-9a9c-edf7c85544da', 'a00ff834-9975-48a4-bc04-13a6d9576b72'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:06:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1319ff45-46b0-48fa-9ae7-9f200f1ffdc8 tempest-SnapshotMetadataTestJSON-1994294245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:06:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1319ff45-46b0-48fa-9ae7-9f200f1ffdc8 tempest-SnapshotMetadataTestJSON-1994294245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:06:38 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1319ff45-46b0-48fa-9ae7-9f200f1ffdc8 tempest-SnapshotMetadataTestJSON-1994294245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:06:38 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1319ff45-46b0-48fa-9ae7-9f200f1ffdc8 tempest-SnapshotMetadataTestJSON-1994294245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:06:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1319ff45-46b0-48fa-9ae7-9f200f1ffdc8 tempest-SnapshotMetadataTestJSON-1994294245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:06:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1319ff45-46b0-48fa-9ae7-9f200f1ffdc8 tempest-SnapshotMetadataTestJSON-1994294245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:38 devstack sudo[95601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:06:38 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:39 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1319ff45-46b0-48fa-9ae7-9f200f1ffdc8 tempest-SnapshotMetadataTestJSON-1994294245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.431s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:39 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-1319ff45-46b0-48fa-9ae7-9f200f1ffdc8 tempest-SnapshotMetadataTestJSON-1994294245 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:06:39 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-1319ff45-46b0-48fa-9ae7-9f200f1ffdc8 tempest-SnapshotMetadataTestJSON-1994294245 None] Deleted volume successfully.
Nov 19 13:06:39 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-1319ff45-46b0-48fa-9ae7-9f200f1ffdc8 tempest-SnapshotMetadataTestJSON-1994294245 None] Lock "cinder-1a1a2442-f1f2-41ce-bfb9-cd0bc739157b-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:06:41 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:06:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Flow 'volume_create_manager' (d0bcbafb-b1f0-4cc4-afd1-0ac66078ac53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:06:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b5ab2c-f8a4-44ed-9993-39e9a653f268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b5ab2c-f8a4-44ed-9993-39e9a653f268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-258035102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37233cf4-d307-474f-a79d-32a44ca63a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4df0bc6de5be4fe68260824218437c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:06:42Z,use_quota=True,user_id='10b282a42a3c4e048a36bec0d6378ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25065c5b-c6bb-4c15-a094-59891807906b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25065c5b-c6bb-4c15-a094-59891807906b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (883b6d3b-665f-4769-a963-b8b8ef506c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (883b6d3b-665f-4769-a963-b8b8ef506c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37233cf4-d307-474f-a79d-32a44ca63a22', 'volume_name': 'volume-37233cf4-d307-474f-a79d-32a44ca63a22', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf7bb7e-90e8-4b70-9798-3ffe5be88c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf7bb7e-90e8-4b70-9798-3ffe5be88c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2494f19a-94db-4d59-99fb-9c9f65768e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:41 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Volume 37233cf4-d307-474f-a79d-32a44ca63a22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37233cf4-d307-474f-a79d-32a44ca63a22', 'volume_size': 1}
Nov 19 13:06:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:06:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:06:41 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-258035102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37233cf4-d307-474f-a79d-32a44ca63a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4df0bc6de5be4fe68260824218437c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:06:42Z,use_quota=True,user_id='10b282a42a3c4e048a36bec0d6378ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:06:41 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Creating volume 37233cf4-d307-474f-a79d-32a44ca63a22 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:06:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:06:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:06:41 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:06:41 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:06:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:06:41 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:06:41 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:06:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-37233cf4-d307-474f-a79d-32a44ca63a22 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:41 devstack sudo[95606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-37233cf4-d307-474f-a79d-32a44ca63a22 1073741824
Nov 19 13:06:41 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Flow 'volume_create_manager' (58cfb921-99df-42a6-ba01-2868a0cbe1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047220d9-1350-4952-a1bc-64d926af55d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047220d9-1350-4952-a1bc-64d926af55d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1616727486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76fd372-d277-4fa0-bec7-a5553d14fe4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f66e688b5a1943268746a692cfe6ed6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:06:42Z,use_quota=True,user_id='a405d1fac9fe4e69a937522feddc6388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54fabd10-b03a-4d75-914d-5bb320f03089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54fabd10-b03a-4d75-914d-5bb320f03089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc756b8-e522-4a3d-ae5a-259806508d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc756b8-e522-4a3d-ae5a-259806508d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c76fd372-d277-4fa0-bec7-a5553d14fe4b', 'volume_name': 'volume-c76fd372-d277-4fa0-bec7-a5553d14fe4b', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06997ff-f6ae-44f0-9be2-41eb382eee22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06997ff-f6ae-44f0-9be2-41eb382eee22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9e88cfa-480d-445c-892e-7b0866d323e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:42 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Volume c76fd372-d277-4fa0-bec7-a5553d14fe4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c76fd372-d277-4fa0-bec7-a5553d14fe4b', 'volume_size': 1}
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:06:42 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-37233cf4-d307-474f-a79d-32a44ca63a22 1073741824" returned: 0 in 0.545s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-37233cf4-d307-474f-a79d-32a44ca63a22 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:42 devstack sudo[95611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-37233cf4-d307-474f-a79d-32a44ca63a22
Nov 19 13:06:42 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:42 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-37233cf4-d307-474f-a79d-32a44ca63a22" returned: 0 in 0.447s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.675s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1616727486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76fd372-d277-4fa0-bec7-a5553d14fe4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f66e688b5a1943268746a692cfe6ed6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:06:42Z,use_quota=True,user_id='a405d1fac9fe4e69a937522feddc6388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Creating volume c76fd372-d277-4fa0-bec7-a5553d14fe4b {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:06:42 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c76fd372-d277-4fa0-bec7-a5553d14fe4b 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2494f19a-94db-4d59-99fb-9c9f65768e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37233cf4-d307-474f-a79d-32a44ca63a22', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:42 devstack sudo[95615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c76fd372-d277-4fa0-bec7-a5553d14fe4b 1073741824
Nov 19 13:06:42 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34f0270b-daa3-4562-9cad-f68d527eda11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:42 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Volume volume-37233cf4-d307-474f-a79d-32a44ca63a22 (37233cf4-d307-474f-a79d-32a44ca63a22): created successfully
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34f0270b-daa3-4562-9cad-f68d527eda11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Flow 'volume_create_manager' (d0bcbafb-b1f0-4cc4-afd1-0ac66078ac53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:06:42 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-16547ec8-a46d-4d05-b2e7-580362610072 tempest-VolumesMetadataTest-455189865 None] Created volume successfully.
Nov 19 13:06:43 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c76fd372-d277-4fa0-bec7-a5553d14fe4b 1073741824" returned: 0 in 0.529s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c76fd372-d277-4fa0-bec7-a5553d14fe4b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:43 devstack sudo[95620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c76fd372-d277-4fa0-bec7-a5553d14fe4b
Nov 19 13:06:43 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:43 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c76fd372-d277-4fa0-bec7-a5553d14fe4b" returned: 0 in 0.429s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:43 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:06:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:06:43 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9e88cfa-480d-445c-892e-7b0866d323e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c76fd372-d277-4fa0-bec7-a5553d14fe4b', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:43 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc05bd7-4be5-4da0-bba0-305d72e7cbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:43 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Volume volume-c76fd372-d277-4fa0-bec7-a5553d14fe4b (c76fd372-d277-4fa0-bec7-a5553d14fe4b): created successfully
Nov 19 13:06:43 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc05bd7-4be5-4da0-bba0-305d72e7cbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:43 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Flow 'volume_create_manager' (58cfb921-99df-42a6-ba01-2868a0cbe1a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:06:43 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-6fc90946-bebd-4309-a109-7d5df70c09d2 tempest-AttachVolumeTestJSON-1179299540 None] Created volume successfully.
Nov 19 13:06:44 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a9ceb778-64e9-4714-a089-cdc9192266d5 tempest-VolumesMetadataTest-455189865 None] Acquiring lock "cinder-37233cf4-d307-474f-a79d-32a44ca63a22-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:06:44 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a9ceb778-64e9-4714-a089-cdc9192266d5 tempest-VolumesMetadataTest-455189865 None] Lock "cinder-37233cf4-d307-474f-a79d-32a44ca63a22-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:06:44 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a9ceb778-64e9-4714-a089-cdc9192266d5 tempest-VolumesMetadataTest-455189865 None] Acquiring lock "cinder-quobyte-37233cf4-d307-474f-a79d-32a44ca63a22" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:06:44 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a9ceb778-64e9-4714-a089-cdc9192266d5 tempest-VolumesMetadataTest-455189865 None] Lock "cinder-quobyte-37233cf4-d307-474f-a79d-32a44ca63a22" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:06:44 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5547bd-bc3a-49a6-80fb-cda12d5442a3]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:06:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a9ceb778-64e9-4714-a089-cdc9192266d5 tempest-VolumesMetadataTest-455189865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-37233cf4-d307-474f-a79d-32a44ca63a22 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:44 devstack sudo[95623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-37233cf4-d307-474f-a79d-32a44ca63a22
Nov 19 13:06:44 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:44 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a9ceb778-64e9-4714-a089-cdc9192266d5 tempest-VolumesMetadataTest-455189865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-37233cf4-d307-474f-a79d-32a44ca63a22" returned: 0 in 0.541s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a9ceb778-64e9-4714-a089-cdc9192266d5 tempest-VolumesMetadataTest-455189865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-37233cf4-d307-474f-a79d-32a44ca63a22 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:44 devstack sudo[95628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-37233cf4-d307-474f-a79d-32a44ca63a22
Nov 19 13:06:44 devstack sudo[95628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:45 devstack sudo[95628]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a9ceb778-64e9-4714-a089-cdc9192266d5 tempest-VolumesMetadataTest-455189865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-37233cf4-d307-474f-a79d-32a44ca63a22" returned: 0 in 0.436s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:45 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a9ceb778-64e9-4714-a089-cdc9192266d5 tempest-VolumesMetadataTest-455189865 None] Lock "cinder-quobyte-37233cf4-d307-474f-a79d-32a44ca63a22" released by "delete_volume" :: held 0.998s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:06:45 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-a9ceb778-64e9-4714-a089-cdc9192266d5 tempest-VolumesMetadataTest-455189865 None] Created reservations ['b58c9d10-0603-455a-935f-67a6af385309', '652a121e-dc16-41ee-93b6-367334ea85d5', '7551ed9e-c2fb-4049-9708-f90aa14ad3dc', 'fc2f0a21-9eea-445a-98ec-83181ae804ca'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:06:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a9ceb778-64e9-4714-a089-cdc9192266d5 tempest-VolumesMetadataTest-455189865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:06:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a9ceb778-64e9-4714-a089-cdc9192266d5 tempest-VolumesMetadataTest-455189865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:06:45 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a9ceb778-64e9-4714-a089-cdc9192266d5 tempest-VolumesMetadataTest-455189865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:06:45 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a9ceb778-64e9-4714-a089-cdc9192266d5 tempest-VolumesMetadataTest-455189865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:06:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a9ceb778-64e9-4714-a089-cdc9192266d5 tempest-VolumesMetadataTest-455189865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:06:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a9ceb778-64e9-4714-a089-cdc9192266d5 tempest-VolumesMetadataTest-455189865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:45 devstack sudo[95631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:06:45 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:45 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a9ceb778-64e9-4714-a089-cdc9192266d5 tempest-VolumesMetadataTest-455189865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.446s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:45 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-a9ceb778-64e9-4714-a089-cdc9192266d5 tempest-VolumesMetadataTest-455189865 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:06:45 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-a9ceb778-64e9-4714-a089-cdc9192266d5 tempest-VolumesMetadataTest-455189865 None] Deleted volume successfully.
Nov 19 13:06:45 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a9ceb778-64e9-4714-a089-cdc9192266d5 tempest-VolumesMetadataTest-455189865 None] Lock "cinder-37233cf4-d307-474f-a79d-32a44ca63a22-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:06:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-db1dd9f2-f862-4778-9690-3b98abdfe600 req-2e860203-4fa6-4629-bc27-028d8b0b5a3b tempest-AttachVolumeTestJSON-1179299540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:06:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-db1dd9f2-f862-4778-9690-3b98abdfe600 req-2e860203-4fa6-4629-bc27-028d8b0b5a3b tempest-AttachVolumeTestJSON-1179299540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:06:47 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b785cd3e-d113-4d31-b458-35e3e0a390ad]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:06:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-db1dd9f2-f862-4778-9690-3b98abdfe600 req-2e860203-4fa6-4629-bc27-028d8b0b5a3b tempest-AttachVolumeTestJSON-1179299540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c76fd372-d277-4fa0-bec7-a5553d14fe4b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:47 devstack sudo[95644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c76fd372-d277-4fa0-bec7-a5553d14fe4b
Nov 19 13:06:47 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:47 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-db1dd9f2-f862-4778-9690-3b98abdfe600 req-2e860203-4fa6-4629-bc27-028d8b0b5a3b tempest-AttachVolumeTestJSON-1179299540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c76fd372-d277-4fa0-bec7-a5553d14fe4b" returned: 0 in 0.648s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-db1dd9f2-f862-4778-9690-3b98abdfe600 req-2e860203-4fa6-4629-bc27-028d8b0b5a3b tempest-AttachVolumeTestJSON-1179299540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.659s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:06:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-db1dd9f2-f862-4778-9690-3b98abdfe600 req-2e860203-4fa6-4629-bc27-028d8b0b5a3b tempest-AttachVolumeTestJSON-1179299540 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-c76fd372-d277-4fa0-bec7-a5553d14fe4b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8604ae85-551f-4741-871c-a5e221d9498f', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 13:06:47 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-db1dd9f2-f862-4778-9690-3b98abdfe600 req-2e860203-4fa6-4629-bc27-028d8b0b5a3b tempest-AttachVolumeTestJSON-1179299540 None] attachment_update completed successfully.
Nov 19 13:06:49 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:06:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Flow 'volume_create_manager' (0cd7c8db-8897-40d4-b30a-136c497c9d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:06:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9485a7-57d8-4c6c-8b8c-9549842edd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9485a7-57d8-4c6c-8b8c-9549842edd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1705539265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d10908f-8ce9-4514-9a24-0ba837f58ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ab63a918404eee89fa1d5096d1e1b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:06:49Z,use_quota=True,user_id='5a65865cc43546b38da2a53801cafb26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ddd871-d360-4b22-b40b-f377b5ad6671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ddd871-d360-4b22-b40b-f377b5ad6671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf8ec2a-5781-41c3-b808-db63738b6636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf8ec2a-5781-41c3-b808-db63738b6636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d10908f-8ce9-4514-9a24-0ba837f58ef1', 'volume_name': 'volume-3d10908f-8ce9-4514-9a24-0ba837f58ef1', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31dc3e35-12fd-41ee-ac45-a152a4551a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31dc3e35-12fd-41ee-ac45-a152a4551a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15fbe7f7-53fd-49d2-ac37-6691e3f1db3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:49 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Volume 3d10908f-8ce9-4514-9a24-0ba837f58ef1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d10908f-8ce9-4514-9a24-0ba837f58ef1', 'volume_size': 1}
Nov 19 13:06:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:06:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:06:49 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1705539265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d10908f-8ce9-4514-9a24-0ba837f58ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ab63a918404eee89fa1d5096d1e1b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:06:49Z,use_quota=True,user_id='5a65865cc43546b38da2a53801cafb26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:06:49 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Creating volume 3d10908f-8ce9-4514-9a24-0ba837f58ef1 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:06:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:06:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:06:49 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:06:49 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:06:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:06:49 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:06:49 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:06:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3d10908f-8ce9-4514-9a24-0ba837f58ef1 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:49 devstack sudo[96043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3d10908f-8ce9-4514-9a24-0ba837f58ef1 1073741824
Nov 19 13:06:49 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:49 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3d10908f-8ce9-4514-9a24-0ba837f58ef1 1073741824" returned: 0 in 0.599s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3d10908f-8ce9-4514-9a24-0ba837f58ef1 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:49 devstack sudo[96051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3d10908f-8ce9-4514-9a24-0ba837f58ef1
Nov 19 13:06:49 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:50 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3d10908f-8ce9-4514-9a24-0ba837f58ef1" returned: 0 in 0.489s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:50 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:06:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:06:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15fbe7f7-53fd-49d2-ac37-6691e3f1db3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d10908f-8ce9-4514-9a24-0ba837f58ef1', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a30e2ceb-0ce6-4cfa-b3ea-1e415085057a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:50 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Volume volume-3d10908f-8ce9-4514-9a24-0ba837f58ef1 (3d10908f-8ce9-4514-9a24-0ba837f58ef1): created successfully
Nov 19 13:06:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a30e2ceb-0ce6-4cfa-b3ea-1e415085057a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Flow 'volume_create_manager' (0cd7c8db-8897-40d4-b30a-136c497c9d28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:06:50 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-9b90b442-c41f-4689-b032-043385e30491 tempest-VolumesTransfersV355Test-173658341 None] Created volume successfully.
Nov 19 13:06:51 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-99fb86e4-b140-4ffe-b33d-afda13731227 tempest-VolumesTransfersV355Test-2079879647 None] Transfer volume completed successfully.
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Flow 'volume_create_manager' (f79708d0-1044-4343-b144-eb086aa20ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a655d6d-1682-4c31-959c-eed599d0f222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a655d6d-1682-4c31-959c-eed599d0f222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1748344816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049c67f9-70ca-4b7a-bd54-a789a8a6bbd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f66e688b5a1943268746a692cfe6ed6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:06:52Z,use_quota=True,user_id='a405d1fac9fe4e69a937522feddc6388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd68a1f-f95e-4a9a-bfe9-785181f02235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd68a1f-f95e-4a9a-bfe9-785181f02235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e685b94-e342-40c6-a59c-3a8cd5c0bdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e685b94-e342-40c6-a59c-3a8cd5c0bdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '049c67f9-70ca-4b7a-bd54-a789a8a6bbd9', 'volume_name': 'volume-049c67f9-70ca-4b7a-bd54-a789a8a6bbd9', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea490798-eb0f-41d2-8760-7bd3d8b61ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea490798-eb0f-41d2-8760-7bd3d8b61ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec8320ab-1211-424d-9eae-b66acd3810e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:52 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Volume 049c67f9-70ca-4b7a-bd54-a789a8a6bbd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-049c67f9-70ca-4b7a-bd54-a789a8a6bbd9', 'volume_size': 1}
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1748344816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049c67f9-70ca-4b7a-bd54-a789a8a6bbd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f66e688b5a1943268746a692cfe6ed6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:06:52Z,use_quota=True,user_id='a405d1fac9fe4e69a937522feddc6388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Creating volume 049c67f9-70ca-4b7a-bd54-a789a8a6bbd9 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:06:52 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-049c67f9-70ca-4b7a-bd54-a789a8a6bbd9 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:52 devstack sudo[96056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-049c67f9-70ca-4b7a-bd54-a789a8a6bbd9 1073741824
Nov 19 13:06:52 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-77f5c349-c251-4188-aa99-d8b9c92744c6 tempest-VolumesTransfersV355Test-802459051 None] Acquiring lock "cinder-3d10908f-8ce9-4514-9a24-0ba837f58ef1-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-77f5c349-c251-4188-aa99-d8b9c92744c6 tempest-VolumesTransfersV355Test-802459051 None] Lock "cinder-3d10908f-8ce9-4514-9a24-0ba837f58ef1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-77f5c349-c251-4188-aa99-d8b9c92744c6 tempest-VolumesTransfersV355Test-802459051 None] Acquiring lock "cinder-quobyte-3d10908f-8ce9-4514-9a24-0ba837f58ef1" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-77f5c349-c251-4188-aa99-d8b9c92744c6 tempest-VolumesTransfersV355Test-802459051 None] Lock "cinder-quobyte-3d10908f-8ce9-4514-9a24-0ba837f58ef1" acquired by "delete_volume" :: waited 0.019s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8123b5c-8bc0-46d2-84b0-8f39a5614589]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-77f5c349-c251-4188-aa99-d8b9c92744c6 tempest-VolumesTransfersV355Test-802459051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3d10908f-8ce9-4514-9a24-0ba837f58ef1 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:52 devstack sudo[96061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3d10908f-8ce9-4514-9a24-0ba837f58ef1
Nov 19 13:06:52 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:52 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-049c67f9-70ca-4b7a-bd54-a789a8a6bbd9 1073741824" returned: 0 in 0.617s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-049c67f9-70ca-4b7a-bd54-a789a8a6bbd9 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:52 devstack sudo[96066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-049c67f9-70ca-4b7a-bd54-a789a8a6bbd9
Nov 19 13:06:52 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:53 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:53 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-77f5c349-c251-4188-aa99-d8b9c92744c6 tempest-VolumesTransfersV355Test-802459051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3d10908f-8ce9-4514-9a24-0ba837f58ef1" returned: 0 in 0.624s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-77f5c349-c251-4188-aa99-d8b9c92744c6 tempest-VolumesTransfersV355Test-802459051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3d10908f-8ce9-4514-9a24-0ba837f58ef1 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-049c67f9-70ca-4b7a-bd54-a789a8a6bbd9" returned: 0 in 0.484s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:53 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:06:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:06:53 devstack sudo[96072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3d10908f-8ce9-4514-9a24-0ba837f58ef1
Nov 19 13:06:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec8320ab-1211-424d-9eae-b66acd3810e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-049c67f9-70ca-4b7a-bd54-a789a8a6bbd9', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:53 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b523e4-95e4-420b-bc04-e3269c73c752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:53 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Volume volume-049c67f9-70ca-4b7a-bd54-a789a8a6bbd9 (049c67f9-70ca-4b7a-bd54-a789a8a6bbd9): created successfully
Nov 19 13:06:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b523e4-95e4-420b-bc04-e3269c73c752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Flow 'volume_create_manager' (f79708d0-1044-4343-b144-eb086aa20ac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:06:53 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-dd0584d0-1c2b-467f-a8c2-2cb34996587f tempest-AttachVolumeTestJSON-1179299540 None] Created volume successfully.
Nov 19 13:06:53 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-77f5c349-c251-4188-aa99-d8b9c92744c6 tempest-VolumesTransfersV355Test-802459051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-3d10908f-8ce9-4514-9a24-0ba837f58ef1" returned: 0 in 0.464s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:53 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-77f5c349-c251-4188-aa99-d8b9c92744c6 tempest-VolumesTransfersV355Test-802459051 None] Lock "cinder-quobyte-3d10908f-8ce9-4514-9a24-0ba837f58ef1" released by "delete_volume" :: held 1.107s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:06:53 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-77f5c349-c251-4188-aa99-d8b9c92744c6 tempest-VolumesTransfersV355Test-802459051 None] Created reservations ['bad37cc7-f461-466b-b722-4a258a4071cd', '03d2d6ed-9a3b-4db3-9032-da85e2f6fe38', '7adecabe-e86f-4563-8c31-d798ccf549d4', '1647e961-66ae-43e2-a809-b3ad18c131dc'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:06:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-77f5c349-c251-4188-aa99-d8b9c92744c6 tempest-VolumesTransfersV355Test-802459051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:06:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-77f5c349-c251-4188-aa99-d8b9c92744c6 tempest-VolumesTransfersV355Test-802459051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:06:53 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-77f5c349-c251-4188-aa99-d8b9c92744c6 tempest-VolumesTransfersV355Test-802459051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:06:53 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-77f5c349-c251-4188-aa99-d8b9c92744c6 tempest-VolumesTransfersV355Test-802459051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:06:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-77f5c349-c251-4188-aa99-d8b9c92744c6 tempest-VolumesTransfersV355Test-802459051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:06:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-77f5c349-c251-4188-aa99-d8b9c92744c6 tempest-VolumesTransfersV355Test-802459051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:53 devstack sudo[96075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:06:53 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:54 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-77f5c349-c251-4188-aa99-d8b9c92744c6 tempest-VolumesTransfersV355Test-802459051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.445s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:54 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-77f5c349-c251-4188-aa99-d8b9c92744c6 tempest-VolumesTransfersV355Test-802459051 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:06:54 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-77f5c349-c251-4188-aa99-d8b9c92744c6 tempest-VolumesTransfersV355Test-802459051 None] Deleted volume successfully.
Nov 19 13:06:54 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-77f5c349-c251-4188-aa99-d8b9c92744c6 tempest-VolumesTransfersV355Test-802459051 None] Lock "cinder-3d10908f-8ce9-4514-9a24-0ba837f58ef1-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:06:55 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:06:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Flow 'volume_create_manager' (e12b221a-2041-454b-8e35-255523d82619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:06:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3da4de1-e3a0-4857-b791-cff07da46fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3da4de1-e3a0-4857-b791-cff07da46fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-882106014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63213927-8954-4d35-85bb-c5754e922294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ab63a918404eee89fa1d5096d1e1b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:06:55Z,use_quota=True,user_id='5a65865cc43546b38da2a53801cafb26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead134e4-7f3f-40bc-8edb-e19a8352adb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead134e4-7f3f-40bc-8edb-e19a8352adb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e03e1c-5ad5-4b58-97f7-a3114c29fd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e03e1c-5ad5-4b58-97f7-a3114c29fd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63213927-8954-4d35-85bb-c5754e922294', 'volume_name': 'volume-63213927-8954-4d35-85bb-c5754e922294', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc1faa9-d6bb-43ee-9a45-b26f975bc363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc1faa9-d6bb-43ee-9a45-b26f975bc363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ecbc98-bd05-4e0e-8796-33fce71b0e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:55 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Volume 63213927-8954-4d35-85bb-c5754e922294: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63213927-8954-4d35-85bb-c5754e922294', 'volume_size': 1}
Nov 19 13:06:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:06:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:06:55 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-882106014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63213927-8954-4d35-85bb-c5754e922294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ab63a918404eee89fa1d5096d1e1b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:06:55Z,use_quota=True,user_id='5a65865cc43546b38da2a53801cafb26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:06:55 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Creating volume 63213927-8954-4d35-85bb-c5754e922294 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:06:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:06:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:06:55 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:06:55 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:06:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:06:55 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:06:55 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:06:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-63213927-8954-4d35-85bb-c5754e922294 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:55 devstack sudo[96078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-63213927-8954-4d35-85bb-c5754e922294 1073741824
Nov 19 13:06:55 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:55 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-63213927-8954-4d35-85bb-c5754e922294 1073741824" returned: 0 in 0.556s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-63213927-8954-4d35-85bb-c5754e922294 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:55 devstack sudo[96083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-63213927-8954-4d35-85bb-c5754e922294
Nov 19 13:06:55 devstack sudo[96083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:56 devstack sudo[96083]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-63213927-8954-4d35-85bb-c5754e922294" returned: 0 in 0.437s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:06:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:06:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ecbc98-bd05-4e0e-8796-33fce71b0e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63213927-8954-4d35-85bb-c5754e922294', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce9b183-7f27-46db-a631-6ba23a9d24d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:06:56 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Volume volume-63213927-8954-4d35-85bb-c5754e922294 (63213927-8954-4d35-85bb-c5754e922294): created successfully
Nov 19 13:06:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce9b183-7f27-46db-a631-6ba23a9d24d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:06:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Flow 'volume_create_manager' (e12b221a-2041-454b-8e35-255523d82619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:06:56 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-27624607-b3ad-4b8c-aea0-6090367c5b46 tempest-VolumesTransfersV355Test-173658341 None] Created volume successfully.
Nov 19 13:06:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-4eacdb17-1314-4e40-8258-b239f0c1e6ac req-4b008812-1532-4ac1-b263-2a4c15eac27f tempest-AttachVolumeTestJSON-1179299540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:06:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-4eacdb17-1314-4e40-8258-b239f0c1e6ac req-4b008812-1532-4ac1-b263-2a4c15eac27f tempest-AttachVolumeTestJSON-1179299540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:06:57 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd5ae8d-19e3-4fda-bc6e-5264396b9acd]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:06:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-4eacdb17-1314-4e40-8258-b239f0c1e6ac req-4b008812-1532-4ac1-b263-2a4c15eac27f tempest-AttachVolumeTestJSON-1179299540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-049c67f9-70ca-4b7a-bd54-a789a8a6bbd9 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:57 devstack sudo[96094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-049c67f9-70ca-4b7a-bd54-a789a8a6bbd9
Nov 19 13:06:57 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:57 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-eca850d8-b097-4013-9e6e-0bb62c1cf2c1 tempest-VolumesTransfersV355Test-802459051 None] Acquiring lock "cinder-63213927-8954-4d35-85bb-c5754e922294-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:06:57 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-eca850d8-b097-4013-9e6e-0bb62c1cf2c1 tempest-VolumesTransfersV355Test-802459051 None] Lock "cinder-63213927-8954-4d35-85bb-c5754e922294-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:06:57 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-eca850d8-b097-4013-9e6e-0bb62c1cf2c1 tempest-VolumesTransfersV355Test-802459051 None] Acquiring lock "cinder-quobyte-63213927-8954-4d35-85bb-c5754e922294" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:06:57 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-eca850d8-b097-4013-9e6e-0bb62c1cf2c1 tempest-VolumesTransfersV355Test-802459051 None] Lock "cinder-quobyte-63213927-8954-4d35-85bb-c5754e922294" acquired by "delete_volume" :: waited 0.012s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:06:57 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c18581d-4a43-404e-830f-16feea50b669]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:06:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-eca850d8-b097-4013-9e6e-0bb62c1cf2c1 tempest-VolumesTransfersV355Test-802459051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-63213927-8954-4d35-85bb-c5754e922294 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:57 devstack sudo[96096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-63213927-8954-4d35-85bb-c5754e922294
Nov 19 13:06:57 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:57 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-4eacdb17-1314-4e40-8258-b239f0c1e6ac req-4b008812-1532-4ac1-b263-2a4c15eac27f tempest-AttachVolumeTestJSON-1179299540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-049c67f9-70ca-4b7a-bd54-a789a8a6bbd9" returned: 0 in 0.588s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-4eacdb17-1314-4e40-8258-b239f0c1e6ac req-4b008812-1532-4ac1-b263-2a4c15eac27f tempest-AttachVolumeTestJSON-1179299540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.598s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:06:57 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-4eacdb17-1314-4e40-8258-b239f0c1e6ac req-4b008812-1532-4ac1-b263-2a4c15eac27f tempest-AttachVolumeTestJSON-1179299540 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-049c67f9-70ca-4b7a-bd54-a789a8a6bbd9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f46d1d6-23ed-4817-bf01-c08ce5852fc6', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 13:06:57 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-4eacdb17-1314-4e40-8258-b239f0c1e6ac req-4b008812-1532-4ac1-b263-2a4c15eac27f tempest-AttachVolumeTestJSON-1179299540 None] attachment_update completed successfully.
Nov 19 13:06:58 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-eca850d8-b097-4013-9e6e-0bb62c1cf2c1 tempest-VolumesTransfersV355Test-802459051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-63213927-8954-4d35-85bb-c5754e922294" returned: 0 in 0.549s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-eca850d8-b097-4013-9e6e-0bb62c1cf2c1 tempest-VolumesTransfersV355Test-802459051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-63213927-8954-4d35-85bb-c5754e922294 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:58 devstack sudo[96107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-63213927-8954-4d35-85bb-c5754e922294
Nov 19 13:06:58 devstack sudo[96107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:58 devstack sudo[96107]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-eca850d8-b097-4013-9e6e-0bb62c1cf2c1 tempest-VolumesTransfersV355Test-802459051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-63213927-8954-4d35-85bb-c5754e922294" returned: 0 in 0.463s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:58 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-eca850d8-b097-4013-9e6e-0bb62c1cf2c1 tempest-VolumesTransfersV355Test-802459051 None] Lock "cinder-quobyte-63213927-8954-4d35-85bb-c5754e922294" released by "delete_volume" :: held 1.036s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:06:58 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-eca850d8-b097-4013-9e6e-0bb62c1cf2c1 tempest-VolumesTransfersV355Test-802459051 None] Created reservations ['4869ffaa-b9e4-40a2-831f-13c4a93665c9', '8b5d274b-4803-4d74-b1e6-d62072677fa5', '07d1abc3-237e-4b00-9ea0-2516bccf5212', 'a573d130-1a75-4443-affc-20670627189a'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:06:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-eca850d8-b097-4013-9e6e-0bb62c1cf2c1 tempest-VolumesTransfersV355Test-802459051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:06:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-eca850d8-b097-4013-9e6e-0bb62c1cf2c1 tempest-VolumesTransfersV355Test-802459051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:06:58 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-eca850d8-b097-4013-9e6e-0bb62c1cf2c1 tempest-VolumesTransfersV355Test-802459051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:06:58 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-eca850d8-b097-4013-9e6e-0bb62c1cf2c1 tempest-VolumesTransfersV355Test-802459051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:06:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-eca850d8-b097-4013-9e6e-0bb62c1cf2c1 tempest-VolumesTransfersV355Test-802459051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:06:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-eca850d8-b097-4013-9e6e-0bb62c1cf2c1 tempest-VolumesTransfersV355Test-802459051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:06:58 devstack sudo[96110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:06:58 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:06:59 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root
Nov 19 13:06:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-eca850d8-b097-4013-9e6e-0bb62c1cf2c1 tempest-VolumesTransfersV355Test-802459051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.457s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:06:59 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-eca850d8-b097-4013-9e6e-0bb62c1cf2c1 tempest-VolumesTransfersV355Test-802459051 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:06:59 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-eca850d8-b097-4013-9e6e-0bb62c1cf2c1 tempest-VolumesTransfersV355Test-802459051 None] Deleted volume successfully.
Nov 19 13:06:59 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-eca850d8-b097-4013-9e6e-0bb62c1cf2c1 tempest-VolumesTransfersV355Test-802459051 None] Lock "cinder-63213927-8954-4d35-85bb-c5754e922294-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:07:03 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:07:03 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Flow 'volume_create_manager' (ca87ee16-7ffe-4541-b8eb-f92fc523d30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:07:03 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1402c3b-3211-475a-a9f7-009a304d76cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:03 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1402c3b-3211-475a-a9f7-009a304d76cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-310073128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21bbc325-c863-45e2-8c47-291554409d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5b0b3cd8a84f9aaa22aa09c6971d72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:07:04Z,use_quota=True,user_id='320800d5528247f684c2b5e388471bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:03 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c505d93-67ab-4c0c-86bb-c5442adb73e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c505d93-67ab-4c0c-86bb-c5442adb73e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0af894a-b083-4ae1-800d-2b49395a276d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0af894a-b083-4ae1-800d-2b49395a276d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21bbc325-c863-45e2-8c47-291554409d99', 'volume_name': 'volume-21bbc325-c863-45e2-8c47-291554409d99', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620a5b2e-cea3-44c7-aef9-5f7738b51445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620a5b2e-cea3-44c7-aef9-5f7738b51445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90be2fae-05fd-4007-aa4f-2e8d51b5656a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:04 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Volume 21bbc325-c863-45e2-8c47-291554409d99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21bbc325-c863-45e2-8c47-291554409d99', 'volume_size': 1}
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-310073128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21bbc325-c863-45e2-8c47-291554409d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5b0b3cd8a84f9aaa22aa09c6971d72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:07:04Z,use_quota=True,user_id='320800d5528247f684c2b5e388471bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Creating volume 21bbc325-c863-45e2-8c47-291554409d99 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:07:04 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-21bbc325-c863-45e2-8c47-291554409d99 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:04 devstack sudo[96119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-21bbc325-c863-45e2-8c47-291554409d99 1073741824
Nov 19 13:07:04 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:04 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-cba37275-6348-4a12-aaf8-c12bf9573dfa req-81b652e6-9a8c-4d8f-b009-225a5e25cdee tempest-AttachVolumeTestJSON-1179299540 None] Terminate volume connection completed successfully.
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-cba37275-6348-4a12-aaf8-c12bf9573dfa req-81b652e6-9a8c-4d8f-b009-225a5e25cdee tempest-AttachVolumeTestJSON-1179299540 None] Deleting attachment 8604ae85-551f-4741-871c-a5e221d9498f. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:04 devstack sudo[96126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:07:04 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:04 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-21bbc325-c863-45e2-8c47-291554409d99 1073741824" returned: 0 in 0.559s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-21bbc325-c863-45e2-8c47-291554409d99 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:04 devstack sudo[96128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-21bbc325-c863-45e2-8c47-291554409d99
Nov 19 13:07:04 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:04 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.428s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:04 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:07:05 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-21bbc325-c863-45e2-8c47-291554409d99" returned: 0 in 0.465s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:05 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:07:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:05 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90be2fae-05fd-4007-aa4f-2e8d51b5656a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21bbc325-c863-45e2-8c47-291554409d99', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:05 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b19e59-0d5b-42df-99b6-545b2dcc61a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:05 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Volume volume-21bbc325-c863-45e2-8c47-291554409d99 (21bbc325-c863-45e2-8c47-291554409d99): created successfully
Nov 19 13:07:05 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b19e59-0d5b-42df-99b6-545b2dcc61a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:05 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Flow 'volume_create_manager' (ca87ee16-7ffe-4541-b8eb-f92fc523d30d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:07:05 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-d56e81cc-e71b-471f-91ac-81b64a28eff0 tempest-VolumesTransfersV357Test-633338958 None] Created volume successfully.
Nov 19 13:07:06 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-2d0c5e3e-41c4-463b-b5dc-e29eec3a7c14 tempest-VolumesTransfersV357Test-430106000 None] Transfer volume completed successfully.
Nov 19 13:07:07 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a8af70f1-5ca6-4cda-a104-e2d0d0233715 tempest-VolumesTransfersV357Test-1511766087 None] Acquiring lock "cinder-21bbc325-c863-45e2-8c47-291554409d99-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:07:07 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a8af70f1-5ca6-4cda-a104-e2d0d0233715 tempest-VolumesTransfersV357Test-1511766087 None] Lock "cinder-21bbc325-c863-45e2-8c47-291554409d99-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:07:07 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a8af70f1-5ca6-4cda-a104-e2d0d0233715 tempest-VolumesTransfersV357Test-1511766087 None] Acquiring lock "cinder-quobyte-21bbc325-c863-45e2-8c47-291554409d99" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:07:07 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a8af70f1-5ca6-4cda-a104-e2d0d0233715 tempest-VolumesTransfersV357Test-1511766087 None] Lock "cinder-quobyte-21bbc325-c863-45e2-8c47-291554409d99" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:07:07 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cf71df-0317-4282-b287-7d95ef24c25f]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:07:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a8af70f1-5ca6-4cda-a104-e2d0d0233715 tempest-VolumesTransfersV357Test-1511766087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-21bbc325-c863-45e2-8c47-291554409d99 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:07 devstack sudo[96132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-21bbc325-c863-45e2-8c47-291554409d99
Nov 19 13:07:07 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:07 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-f5acab3e-05d1-4fb2-96c8-99b2d7691510 req-4a381c2d-5943-455b-9cba-395d7e4dbc8f tempest-AttachVolumeTestJSON-1179299540 None] Terminate volume connection completed successfully.
Nov 19 13:07:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-f5acab3e-05d1-4fb2-96c8-99b2d7691510 req-4a381c2d-5943-455b-9cba-395d7e4dbc8f tempest-AttachVolumeTestJSON-1179299540 None] Deleting attachment 8f46d1d6-23ed-4817-bf01-c08ce5852fc6. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 13:07:07 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a8af70f1-5ca6-4cda-a104-e2d0d0233715 tempest-VolumesTransfersV357Test-1511766087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-21bbc325-c863-45e2-8c47-291554409d99" returned: 0 in 0.580s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a8af70f1-5ca6-4cda-a104-e2d0d0233715 tempest-VolumesTransfersV357Test-1511766087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-21bbc325-c863-45e2-8c47-291554409d99 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:07 devstack sudo[96164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-21bbc325-c863-45e2-8c47-291554409d99
Nov 19 13:07:07 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:08 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a8af70f1-5ca6-4cda-a104-e2d0d0233715 tempest-VolumesTransfersV357Test-1511766087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-21bbc325-c863-45e2-8c47-291554409d99" returned: 0 in 0.453s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:08 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a8af70f1-5ca6-4cda-a104-e2d0d0233715 tempest-VolumesTransfersV357Test-1511766087 None] Lock "cinder-quobyte-21bbc325-c863-45e2-8c47-291554409d99" released by "delete_volume" :: held 1.069s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:07:08 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-a8af70f1-5ca6-4cda-a104-e2d0d0233715 tempest-VolumesTransfersV357Test-1511766087 None] Created reservations ['c311811b-1493-4858-8690-faa6780240f7', 'f42ee9d0-8b92-4e9c-aecc-22eba2a40ae5', '1222796f-9028-41c0-8fcb-4b1b58c6b161', '3819646d-d9da-49ec-b775-30665be6e633'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:07:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a8af70f1-5ca6-4cda-a104-e2d0d0233715 tempest-VolumesTransfersV357Test-1511766087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a8af70f1-5ca6-4cda-a104-e2d0d0233715 tempest-VolumesTransfersV357Test-1511766087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:08 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a8af70f1-5ca6-4cda-a104-e2d0d0233715 tempest-VolumesTransfersV357Test-1511766087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:07:08 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a8af70f1-5ca6-4cda-a104-e2d0d0233715 tempest-VolumesTransfersV357Test-1511766087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:07:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a8af70f1-5ca6-4cda-a104-e2d0d0233715 tempest-VolumesTransfersV357Test-1511766087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a8af70f1-5ca6-4cda-a104-e2d0d0233715 tempest-VolumesTransfersV357Test-1511766087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:08 devstack sudo[96168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:07:08 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:08 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a8af70f1-5ca6-4cda-a104-e2d0d0233715 tempest-VolumesTransfersV357Test-1511766087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.443s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:08 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-a8af70f1-5ca6-4cda-a104-e2d0d0233715 tempest-VolumesTransfersV357Test-1511766087 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:07:08 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-a8af70f1-5ca6-4cda-a104-e2d0d0233715 tempest-VolumesTransfersV357Test-1511766087 None] Deleted volume successfully.
Nov 19 13:07:08 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a8af70f1-5ca6-4cda-a104-e2d0d0233715 tempest-VolumesTransfersV357Test-1511766087 None] Lock "cinder-21bbc325-c863-45e2-8c47-291554409d99-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:07:09 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:07:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Flow 'volume_create_manager' (4a9fdb48-9c0e-4e3e-97ac-bb712e3d12f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:07:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f8ec75e-5111-481a-a424-16196cb53ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f8ec75e-5111-481a-a424-16196cb53ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-332904871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67258b73-73f4-443c-b083-5d1dbcc0d35e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5b0b3cd8a84f9aaa22aa09c6971d72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:07:10Z,use_quota=True,user_id='320800d5528247f684c2b5e388471bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4fb42c-b491-44fd-a7cc-0c2a9ddeb198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4fb42c-b491-44fd-a7cc-0c2a9ddeb198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39a27859-1d3a-4778-9c39-2e3b5d6041a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39a27859-1d3a-4778-9c39-2e3b5d6041a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67258b73-73f4-443c-b083-5d1dbcc0d35e', 'volume_name': 'volume-67258b73-73f4-443c-b083-5d1dbcc0d35e', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00deb048-1e62-4dd0-813d-6349be15df71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00deb048-1e62-4dd0-813d-6349be15df71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6211846-8351-4948-9558-233e96d5c9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:09 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Volume 67258b73-73f4-443c-b083-5d1dbcc0d35e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67258b73-73f4-443c-b083-5d1dbcc0d35e', 'volume_size': 1}
Nov 19 13:07:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:09 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-332904871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67258b73-73f4-443c-b083-5d1dbcc0d35e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5b0b3cd8a84f9aaa22aa09c6971d72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:07:10Z,use_quota=True,user_id='320800d5528247f684c2b5e388471bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:07:09 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Creating volume 67258b73-73f4-443c-b083-5d1dbcc0d35e {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:07:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:09 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:07:09 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:07:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:09 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:07:09 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:07:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-67258b73-73f4-443c-b083-5d1dbcc0d35e 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:09 devstack sudo[96171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-67258b73-73f4-443c-b083-5d1dbcc0d35e 1073741824
Nov 19 13:07:09 devstack sudo[96171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:10 devstack sudo[96171]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-67258b73-73f4-443c-b083-5d1dbcc0d35e 1073741824" returned: 0 in 0.505s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-67258b73-73f4-443c-b083-5d1dbcc0d35e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:10 devstack sudo[96176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-67258b73-73f4-443c-b083-5d1dbcc0d35e
Nov 19 13:07:10 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:10 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-67258b73-73f4-443c-b083-5d1dbcc0d35e" returned: 0 in 0.631s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:10 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:07:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:10 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6211846-8351-4948-9558-233e96d5c9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67258b73-73f4-443c-b083-5d1dbcc0d35e', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:10 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3906b96-13d4-4710-b898-74a2ee34a76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:10 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Volume volume-67258b73-73f4-443c-b083-5d1dbcc0d35e (67258b73-73f4-443c-b083-5d1dbcc0d35e): created successfully
Nov 19 13:07:10 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3906b96-13d4-4710-b898-74a2ee34a76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:10 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Flow 'volume_create_manager' (4a9fdb48-9c0e-4e3e-97ac-bb712e3d12f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:07:10 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-46ea0863-b53b-4ded-a6b4-068abd179c3a tempest-VolumesTransfersV357Test-633338958 None] Created volume successfully.
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-437521b7-0306-4080-9fff-6c57e7866ee7 tempest-VolumesTransfersV357Test-1511766087 None] Acquiring lock "cinder-67258b73-73f4-443c-b083-5d1dbcc0d35e-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-437521b7-0306-4080-9fff-6c57e7866ee7 tempest-VolumesTransfersV357Test-1511766087 None] Lock "cinder-67258b73-73f4-443c-b083-5d1dbcc0d35e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-437521b7-0306-4080-9fff-6c57e7866ee7 tempest-VolumesTransfersV357Test-1511766087 None] Acquiring lock "cinder-quobyte-67258b73-73f4-443c-b083-5d1dbcc0d35e" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-437521b7-0306-4080-9fff-6c57e7866ee7 tempest-VolumesTransfersV357Test-1511766087 None] Lock "cinder-quobyte-67258b73-73f4-443c-b083-5d1dbcc0d35e" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f8e31d-632b-4352-82e6-9da8ccf79c74]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-437521b7-0306-4080-9fff-6c57e7866ee7 tempest-VolumesTransfersV357Test-1511766087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-67258b73-73f4-443c-b083-5d1dbcc0d35e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:12 devstack sudo[96213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-67258b73-73f4-443c-b083-5d1dbcc0d35e
Nov 19 13:07:12 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:12 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-437521b7-0306-4080-9fff-6c57e7866ee7 tempest-VolumesTransfersV357Test-1511766087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-67258b73-73f4-443c-b083-5d1dbcc0d35e" returned: 0 in 0.575s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-437521b7-0306-4080-9fff-6c57e7866ee7 tempest-VolumesTransfersV357Test-1511766087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-67258b73-73f4-443c-b083-5d1dbcc0d35e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:12 devstack sudo[96219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-67258b73-73f4-443c-b083-5d1dbcc0d35e
Nov 19 13:07:12 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Flow 'volume_create_manager' (e9aef8a2-4b62-48c2-a9d8-456f9cb8b983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68e3ea4-9604-4038-84c8-26cef54d1095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68e3ea4-9604-4038-84c8-26cef54d1095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2125081649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=983efcf5-5f94-46ac-830c-86ce7ee876c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ae600235364684a3ece8ba4a7a30fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:07:13Z,use_quota=True,user_id='fdabf0fb0c394098a64bddf4f82a9d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84f145b-55e3-467c-ae16-9c4431bf678a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84f145b-55e3-467c-ae16-9c4431bf678a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a9be323-fd8a-44d5-9df6-f3f15eeb3b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a9be323-fd8a-44d5-9df6-f3f15eeb3b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '983efcf5-5f94-46ac-830c-86ce7ee876c6', 'volume_name': 'volume-983efcf5-5f94-46ac-830c-86ce7ee876c6', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de44d684-2136-47aa-ae34-c0f4121c4854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de44d684-2136-47aa-ae34-c0f4121c4854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec76f70-7454-413e-80de-1407de09ad19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:12 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Volume 983efcf5-5f94-46ac-830c-86ce7ee876c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-983efcf5-5f94-46ac-830c-86ce7ee876c6', 'volume_size': 1}
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2125081649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=983efcf5-5f94-46ac-830c-86ce7ee876c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ae600235364684a3ece8ba4a7a30fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:07:13Z,use_quota=True,user_id='fdabf0fb0c394098a64bddf4f82a9d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Creating volume 983efcf5-5f94-46ac-830c-86ce7ee876c6 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:07:12 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:07:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-983efcf5-5f94-46ac-830c-86ce7ee876c6 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:12 devstack sudo[96222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-983efcf5-5f94-46ac-830c-86ce7ee876c6 1073741824
Nov 19 13:07:12 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:13 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-437521b7-0306-4080-9fff-6c57e7866ee7 tempest-VolumesTransfersV357Test-1511766087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-67258b73-73f4-443c-b083-5d1dbcc0d35e" returned: 0 in 0.509s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:13 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-437521b7-0306-4080-9fff-6c57e7866ee7 tempest-VolumesTransfersV357Test-1511766087 None] Lock "cinder-quobyte-67258b73-73f4-443c-b083-5d1dbcc0d35e" released by "delete_volume" :: held 1.117s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:07:13 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-437521b7-0306-4080-9fff-6c57e7866ee7 tempest-VolumesTransfersV357Test-1511766087 None] Created reservations ['3d1ea051-050f-46c0-8735-07e7d8ddfc98', '2fbcabd3-2dcd-424c-a8bb-d2dca648d52f', '2a3e54a8-3670-4468-9d8e-353464a781ec', '23e0fccd-d498-48c8-9b70-c5d4877ecfad'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:07:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-437521b7-0306-4080-9fff-6c57e7866ee7 tempest-VolumesTransfersV357Test-1511766087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-437521b7-0306-4080-9fff-6c57e7866ee7 tempest-VolumesTransfersV357Test-1511766087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:13 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-437521b7-0306-4080-9fff-6c57e7866ee7 tempest-VolumesTransfersV357Test-1511766087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:07:13 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-437521b7-0306-4080-9fff-6c57e7866ee7 tempest-VolumesTransfersV357Test-1511766087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:07:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-437521b7-0306-4080-9fff-6c57e7866ee7 tempest-VolumesTransfersV357Test-1511766087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-437521b7-0306-4080-9fff-6c57e7866ee7 tempest-VolumesTransfersV357Test-1511766087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:13 devstack sudo[96225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:07:13 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:13 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-983efcf5-5f94-46ac-830c-86ce7ee876c6 1073741824" returned: 0 in 0.571s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-983efcf5-5f94-46ac-830c-86ce7ee876c6 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:13 devstack sudo[96230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-983efcf5-5f94-46ac-830c-86ce7ee876c6
Nov 19 13:07:13 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:13 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-437521b7-0306-4080-9fff-6c57e7866ee7 tempest-VolumesTransfersV357Test-1511766087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.462s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:13 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-437521b7-0306-4080-9fff-6c57e7866ee7 tempest-VolumesTransfersV357Test-1511766087 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:07:13 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-437521b7-0306-4080-9fff-6c57e7866ee7 tempest-VolumesTransfersV357Test-1511766087 None] Deleted volume successfully.
Nov 19 13:07:13 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-437521b7-0306-4080-9fff-6c57e7866ee7 tempest-VolumesTransfersV357Test-1511766087 None] Lock "cinder-67258b73-73f4-443c-b083-5d1dbcc0d35e-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:07:13 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-983efcf5-5f94-46ac-830c-86ce7ee876c6" returned: 0 in 0.448s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:13 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:07:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec76f70-7454-413e-80de-1407de09ad19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-983efcf5-5f94-46ac-830c-86ce7ee876c6', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b1861f6-53be-4b87-9f94-524f0cf56a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:13 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Volume volume-983efcf5-5f94-46ac-830c-86ce7ee876c6 (983efcf5-5f94-46ac-830c-86ce7ee876c6): created successfully
Nov 19 13:07:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b1861f6-53be-4b87-9f94-524f0cf56a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Flow 'volume_create_manager' (e9aef8a2-4b62-48c2-a9d8-456f9cb8b983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:07:14 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-db4258d2-c915-4a25-9959-b96ef6debedc tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Created volume successfully.
Nov 19 13:07:16 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-76d16cce-41a9-45b6-b4ec-277e23c6e192 tempest-AttachVolumeTestJSON-1179299540 None] Acquiring lock "cinder-049c67f9-70ca-4b7a-bd54-a789a8a6bbd9-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:07:16 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-76d16cce-41a9-45b6-b4ec-277e23c6e192 tempest-AttachVolumeTestJSON-1179299540 None] Lock "cinder-049c67f9-70ca-4b7a-bd54-a789a8a6bbd9-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:07:16 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=81,cinder:UPDATE=91,cinder:INSERT=24,cinder:DELETE=3 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:07:16 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:UPDATE=84,cinder:SELECT=65,cinder:INSERT=21,cinder:DELETE=15 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:07:16 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-76d16cce-41a9-45b6-b4ec-277e23c6e192 tempest-AttachVolumeTestJSON-1179299540 None] Acquiring lock "cinder-quobyte-049c67f9-70ca-4b7a-bd54-a789a8a6bbd9" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:07:16 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-76d16cce-41a9-45b6-b4ec-277e23c6e192 tempest-AttachVolumeTestJSON-1179299540 None] Lock "cinder-quobyte-049c67f9-70ca-4b7a-bd54-a789a8a6bbd9" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:07:16 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d942f571-0dab-422a-b72b-d891729a701b]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:07:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-76d16cce-41a9-45b6-b4ec-277e23c6e192 tempest-AttachVolumeTestJSON-1179299540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-049c67f9-70ca-4b7a-bd54-a789a8a6bbd9 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:17 devstack sudo[96234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-049c67f9-70ca-4b7a-bd54-a789a8a6bbd9
Nov 19 13:07:17 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:17 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:07:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Flow 'volume_create_manager' (9370e818-9d69-4b49-9dc4-396316d3be07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:07:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1494684c-590f-40bf-b0c9-16afed19d29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1494684c-590f-40bf-b0c9-16afed19d29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-263415063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ee5bdd-35ca-403e-893a-3a46035877ff,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a0e8cd3382e2413c8fd0613b9d668a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:07:18Z,use_quota=True,user_id='943500ec6e95493e97f474f3907dbdba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb9c8c2-fcfd-4dc4-8d21-b2cadb1a086b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb9c8c2-fcfd-4dc4-8d21-b2cadb1a086b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdbc443f-38f3-44e3-aa1c-eb1e18c2e3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:17 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdbc443f-38f3-44e3-aa1c-eb1e18c2e3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04ee5bdd-35ca-403e-893a-3a46035877ff', 'volume_name': 'volume-04ee5bdd-35ca-403e-893a-3a46035877ff', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60cffd9-ee0c-406e-96cc-b147e6a6a3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60cffd9-ee0c-406e-96cc-b147e6a6a3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa97e17-957c-4522-813f-e3f8d9a02b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:17 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Volume 04ee5bdd-35ca-403e-893a-3a46035877ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04ee5bdd-35ca-403e-893a-3a46035877ff', 'volume_size': 1}
Nov 19 13:07:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-263415063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ee5bdd-35ca-403e-893a-3a46035877ff,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a0e8cd3382e2413c8fd0613b9d668a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:07:18Z,use_quota=True,user_id='943500ec6e95493e97f474f3907dbdba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:07:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Creating volume 04ee5bdd-35ca-403e-893a-3a46035877ff {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:07:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:07:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:07:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:07:17 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:07:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-04ee5bdd-35ca-403e-893a-3a46035877ff 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-76d16cce-41a9-45b6-b4ec-277e23c6e192 tempest-AttachVolumeTestJSON-1179299540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-049c67f9-70ca-4b7a-bd54-a789a8a6bbd9" returned: 0 in 0.641s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-76d16cce-41a9-45b6-b4ec-277e23c6e192 tempest-AttachVolumeTestJSON-1179299540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-049c67f9-70ca-4b7a-bd54-a789a8a6bbd9 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:17 devstack sudo[96239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-04ee5bdd-35ca-403e-893a-3a46035877ff 1073741824
Nov 19 13:07:17 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:17 devstack sudo[96240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-049c67f9-70ca-4b7a-bd54-a789a8a6bbd9
Nov 19 13:07:17 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-266bd446-56ed-4b96-9963-3af5eb88f24a req-64e6291a-5247-428e-8649-ed5add17d69f tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:18 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-76d16cce-41a9-45b6-b4ec-277e23c6e192 tempest-AttachVolumeTestJSON-1179299540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-049c67f9-70ca-4b7a-bd54-a789a8a6bbd9" returned: 0 in 0.459s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-76d16cce-41a9-45b6-b4ec-277e23c6e192 tempest-AttachVolumeTestJSON-1179299540 None] Lock "cinder-quobyte-049c67f9-70ca-4b7a-bd54-a789a8a6bbd9" released by "delete_volume" :: held 1.126s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:07:18 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-76d16cce-41a9-45b6-b4ec-277e23c6e192 tempest-AttachVolumeTestJSON-1179299540 None] Created reservations ['16ae1ec7-f298-4b18-a1b3-c0a28fe70a35', 'c6b78136-caf9-4f31-a5f8-04c50dc73ac6', 'd5b96350-7146-4e63-b534-cd8ed8f4562a', '81098503-047f-44e7-8fd8-34435c5cf555'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:07:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-76d16cce-41a9-45b6-b4ec-277e23c6e192 tempest-AttachVolumeTestJSON-1179299540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-76d16cce-41a9-45b6-b4ec-277e23c6e192 tempest-AttachVolumeTestJSON-1179299540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-76d16cce-41a9-45b6-b4ec-277e23c6e192 tempest-AttachVolumeTestJSON-1179299540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:07:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-76d16cce-41a9-45b6-b4ec-277e23c6e192 tempest-AttachVolumeTestJSON-1179299540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:07:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-76d16cce-41a9-45b6-b4ec-277e23c6e192 tempest-AttachVolumeTestJSON-1179299540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-76d16cce-41a9-45b6-b4ec-277e23c6e192 tempest-AttachVolumeTestJSON-1179299540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:18 devstack sudo[96260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:07:18 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:18 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-04ee5bdd-35ca-403e-893a-3a46035877ff 1073741824" returned: 0 in 0.634s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-04ee5bdd-35ca-403e-893a-3a46035877ff {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:18 devstack sudo[96262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-04ee5bdd-35ca-403e-893a-3a46035877ff
Nov 19 13:07:18 devstack sudo[96262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:18 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-76d16cce-41a9-45b6-b4ec-277e23c6e192 tempest-AttachVolumeTestJSON-1179299540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.479s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:18 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-76d16cce-41a9-45b6-b4ec-277e23c6e192 tempest-AttachVolumeTestJSON-1179299540 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:07:18 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-76d16cce-41a9-45b6-b4ec-277e23c6e192 tempest-AttachVolumeTestJSON-1179299540 None] Deleted volume successfully.
Nov 19 13:07:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-76d16cce-41a9-45b6-b4ec-277e23c6e192 tempest-AttachVolumeTestJSON-1179299540 None] Lock "cinder-049c67f9-70ca-4b7a-bd54-a789a8a6bbd9-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:07:18 devstack sudo[96262]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-04ee5bdd-35ca-403e-893a-3a46035877ff" returned: 0 in 0.467s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:07:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-266bd446-56ed-4b96-9963-3af5eb88f24a req-64e6291a-5247-428e-8649-ed5add17d69f tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.866s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa97e17-957c-4522-813f-e3f8d9a02b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04ee5bdd-35ca-403e-893a-3a46035877ff', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f1c4b3-eb61-4f41-8840-a7aae25057d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:18 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[004ef65c-6c8d-424c-a3fe-3eaa26074701]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:07:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-266bd446-56ed-4b96-9963-3af5eb88f24a req-64e6291a-5247-428e-8649-ed5add17d69f tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-983efcf5-5f94-46ac-830c-86ce7ee876c6 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:18 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Volume volume-04ee5bdd-35ca-403e-893a-3a46035877ff (04ee5bdd-35ca-403e-893a-3a46035877ff): created successfully
Nov 19 13:07:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f1c4b3-eb61-4f41-8840-a7aae25057d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Flow 'volume_create_manager' (9370e818-9d69-4b49-9dc4-396316d3be07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:07:18 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-dd7a7246-ad87-4459-ae50-d64c86212ff3 tempest-VolumesGetTest-563067098 None] Created volume successfully.
Nov 19 13:07:18 devstack sudo[96266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-983efcf5-5f94-46ac-830c-86ce7ee876c6
Nov 19 13:07:18 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:19 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9ce0be14-5f79-4030-aba1-382ef4eadd1c tempest-AttachVolumeTestJSON-1179299540 None] Acquiring lock "cinder-c76fd372-d277-4fa0-bec7-a5553d14fe4b-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:07:19 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9ce0be14-5f79-4030-aba1-382ef4eadd1c tempest-AttachVolumeTestJSON-1179299540 None] Lock "cinder-c76fd372-d277-4fa0-bec7-a5553d14fe4b-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:07:19 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9ce0be14-5f79-4030-aba1-382ef4eadd1c tempest-AttachVolumeTestJSON-1179299540 None] Acquiring lock "cinder-quobyte-c76fd372-d277-4fa0-bec7-a5553d14fe4b" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:07:19 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9ce0be14-5f79-4030-aba1-382ef4eadd1c tempest-AttachVolumeTestJSON-1179299540 None] Lock "cinder-quobyte-c76fd372-d277-4fa0-bec7-a5553d14fe4b" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:07:19 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[29670d57-1d99-4a22-b19c-aa595c0afbab]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:07:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9ce0be14-5f79-4030-aba1-382ef4eadd1c tempest-AttachVolumeTestJSON-1179299540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c76fd372-d277-4fa0-bec7-a5553d14fe4b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:19 devstack sudo[96268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c76fd372-d277-4fa0-bec7-a5553d14fe4b
Nov 19 13:07:19 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:19 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-266bd446-56ed-4b96-9963-3af5eb88f24a req-64e6291a-5247-428e-8649-ed5add17d69f tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-983efcf5-5f94-46ac-830c-86ce7ee876c6" returned: 0 in 0.586s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-266bd446-56ed-4b96-9963-3af5eb88f24a req-64e6291a-5247-428e-8649-ed5add17d69f tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.605s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:19 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-266bd446-56ed-4b96-9963-3af5eb88f24a req-64e6291a-5247-428e-8649-ed5add17d69f tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-983efcf5-5f94-46ac-830c-86ce7ee876c6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a2525782-ca81-431b-b3d8-d657fe3fe0f8', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 13:07:19 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-266bd446-56ed-4b96-9963-3af5eb88f24a req-64e6291a-5247-428e-8649-ed5add17d69f tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] attachment_update completed successfully.
Nov 19 13:07:19 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9ce0be14-5f79-4030-aba1-382ef4eadd1c tempest-AttachVolumeTestJSON-1179299540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c76fd372-d277-4fa0-bec7-a5553d14fe4b" returned: 0 in 0.582s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9ce0be14-5f79-4030-aba1-382ef4eadd1c tempest-AttachVolumeTestJSON-1179299540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c76fd372-d277-4fa0-bec7-a5553d14fe4b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:19 devstack sudo[96276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c76fd372-d277-4fa0-bec7-a5553d14fe4b
Nov 19 13:07:19 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Flow 'volume_create_manager' (2af4aff8-0017-42f9-8be6-c933ea2de4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a847beb6-ed10-4622-bcfe-c0c13d3e7ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a847beb6-ed10-4622-bcfe-c0c13d3e7ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:07:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-169446438',display_name='tempest-VolumesGetTest-Volume-580347231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcef2492-58e0-464c-b328-48b7c3459b86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e8cd3382e2413c8fd0613b9d668a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:07:20Z,use_quota=True,user_id='943500ec6e95493e97f474f3907dbdba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205854ff-f447-4282-a889-5216cf0cac21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205854ff-f447-4282-a889-5216cf0cac21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d1b88e5-92e7-4357-9c81-011349a7d7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d1b88e5-92e7-4357-9c81-011349a7d7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcef2492-58e0-464c-b328-48b7c3459b86', 'volume_name': 'volume-dcef2492-58e0-464c-b328-48b7c3459b86', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3863633d-5530-4e95-9e2d-ad4298dabb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3863633d-5530-4e95-9e2d-ad4298dabb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3543f5fe-76d2-45e3-95df-e067600ade43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:20 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Volume dcef2492-58e0-464c-b328-48b7c3459b86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcef2492-58e0-464c-b328-48b7c3459b86', 'volume_size': 1}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:07:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-169446438',display_name='tempest-VolumesGetTest-Volume-580347231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcef2492-58e0-464c-b328-48b7c3459b86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e8cd3382e2413c8fd0613b9d668a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:07:20Z,use_quota=True,user_id='943500ec6e95493e97f474f3907dbdba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Creating volume dcef2492-58e0-464c-b328-48b7c3459b86 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:07:20 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dcef2492-58e0-464c-b328-48b7c3459b86 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:20 devstack sudo[96345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dcef2492-58e0-464c-b328-48b7c3459b86 1073741824
Nov 19 13:07:20 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:20 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9ce0be14-5f79-4030-aba1-382ef4eadd1c tempest-AttachVolumeTestJSON-1179299540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c76fd372-d277-4fa0-bec7-a5553d14fe4b" returned: 0 in 0.475s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9ce0be14-5f79-4030-aba1-382ef4eadd1c tempest-AttachVolumeTestJSON-1179299540 None] Lock "cinder-quobyte-c76fd372-d277-4fa0-bec7-a5553d14fe4b" released by "delete_volume" :: held 1.078s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-9ce0be14-5f79-4030-aba1-382ef4eadd1c tempest-AttachVolumeTestJSON-1179299540 None] Created reservations ['1dfcdc53-71ec-4225-85c1-43bf3fda77df', '1ad2a048-10b8-4d56-abe2-249b34537b37', '5663a00d-1806-40e5-8630-1a1692744957', 'eab5ec70-4328-49e3-9d31-5847cf5b705e'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9ce0be14-5f79-4030-aba1-382ef4eadd1c tempest-AttachVolumeTestJSON-1179299540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9ce0be14-5f79-4030-aba1-382ef4eadd1c tempest-AttachVolumeTestJSON-1179299540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-9ce0be14-5f79-4030-aba1-382ef4eadd1c tempest-AttachVolumeTestJSON-1179299540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-9ce0be14-5f79-4030-aba1-382ef4eadd1c tempest-AttachVolumeTestJSON-1179299540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9ce0be14-5f79-4030-aba1-382ef4eadd1c tempest-AttachVolumeTestJSON-1179299540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9ce0be14-5f79-4030-aba1-382ef4eadd1c tempest-AttachVolumeTestJSON-1179299540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:20 devstack sudo[96348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:07:20 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a8eef5af-5013-442d-bb31-00a056850061 tempest-AttachVolumeTestJSON-1179299540 None] Acquiring lock "cinder-ee3c1914-a204-4d6b-91ae-916ee2c1584b-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a8eef5af-5013-442d-bb31-00a056850061 tempest-AttachVolumeTestJSON-1179299540 None] Lock "cinder-ee3c1914-a204-4d6b-91ae-916ee2c1584b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a8eef5af-5013-442d-bb31-00a056850061 tempest-AttachVolumeTestJSON-1179299540 None] Acquiring lock "cinder-quobyte-ee3c1914-a204-4d6b-91ae-916ee2c1584b" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a8eef5af-5013-442d-bb31-00a056850061 tempest-AttachVolumeTestJSON-1179299540 None] Lock "cinder-quobyte-ee3c1914-a204-4d6b-91ae-916ee2c1584b" acquired by "delete_volume" :: waited 0.006s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fab8507-1228-44af-88eb-5ac062704aa2]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a8eef5af-5013-442d-bb31-00a056850061 tempest-AttachVolumeTestJSON-1179299540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee3c1914-a204-4d6b-91ae-916ee2c1584b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:20 devstack sudo[96666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee3c1914-a204-4d6b-91ae-916ee2c1584b
Nov 19 13:07:20 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:20 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dcef2492-58e0-464c-b328-48b7c3459b86 1073741824" returned: 0 in 0.674s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dcef2492-58e0-464c-b328-48b7c3459b86 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:20 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9ce0be14-5f79-4030-aba1-382ef4eadd1c tempest-AttachVolumeTestJSON-1179299540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.519s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-9ce0be14-5f79-4030-aba1-382ef4eadd1c tempest-AttachVolumeTestJSON-1179299540 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:07:20 devstack sudo[96673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dcef2492-58e0-464c-b328-48b7c3459b86
Nov 19 13:07:20 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-9ce0be14-5f79-4030-aba1-382ef4eadd1c tempest-AttachVolumeTestJSON-1179299540 None] Deleted volume successfully.
Nov 19 13:07:20 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9ce0be14-5f79-4030-aba1-382ef4eadd1c tempest-AttachVolumeTestJSON-1179299540 None] Lock "cinder-c76fd372-d277-4fa0-bec7-a5553d14fe4b-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:07:21 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a8eef5af-5013-442d-bb31-00a056850061 tempest-AttachVolumeTestJSON-1179299540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee3c1914-a204-4d6b-91ae-916ee2c1584b" returned: 0 in 0.610s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a8eef5af-5013-442d-bb31-00a056850061 tempest-AttachVolumeTestJSON-1179299540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee3c1914-a204-4d6b-91ae-916ee2c1584b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:21 devstack sudo[96678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee3c1914-a204-4d6b-91ae-916ee2c1584b
Nov 19 13:07:21 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:21 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dcef2492-58e0-464c-b328-48b7c3459b86" returned: 0 in 0.501s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:21 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:07:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3543f5fe-76d2-45e3-95df-e067600ade43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcef2492-58e0-464c-b328-48b7c3459b86', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e30aa9c-3325-4da9-9b63-dc2c14c96425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:21 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Volume volume-dcef2492-58e0-464c-b328-48b7c3459b86 (dcef2492-58e0-464c-b328-48b7c3459b86): created successfully
Nov 19 13:07:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e30aa9c-3325-4da9-9b63-dc2c14c96425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Flow 'volume_create_manager' (2af4aff8-0017-42f9-8be6-c933ea2de4f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:07:21 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-55662a1f-bc8a-46f6-bb55-039eaa421007 tempest-VolumesGetTest-563067098 None] Created volume successfully.
Nov 19 13:07:21 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a8eef5af-5013-442d-bb31-00a056850061 tempest-AttachVolumeTestJSON-1179299540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee3c1914-a204-4d6b-91ae-916ee2c1584b" returned: 0 in 0.477s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:21 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a8eef5af-5013-442d-bb31-00a056850061 tempest-AttachVolumeTestJSON-1179299540 None] Lock "cinder-quobyte-ee3c1914-a204-4d6b-91ae-916ee2c1584b" released by "delete_volume" :: held 1.126s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:07:21 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-a8eef5af-5013-442d-bb31-00a056850061 tempest-AttachVolumeTestJSON-1179299540 None] Created reservations ['2ca39c83-612f-4569-8d10-c909b2a27558', '2090016f-8915-48fc-958f-1af217f7f6d6', '08385d7a-8c1a-4c2d-a451-675bc9341431', 'c6f39388-9918-409b-9632-d7a5d5a32790'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:07:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a8eef5af-5013-442d-bb31-00a056850061 tempest-AttachVolumeTestJSON-1179299540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a8eef5af-5013-442d-bb31-00a056850061 tempest-AttachVolumeTestJSON-1179299540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:21 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a8eef5af-5013-442d-bb31-00a056850061 tempest-AttachVolumeTestJSON-1179299540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:07:21 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a8eef5af-5013-442d-bb31-00a056850061 tempest-AttachVolumeTestJSON-1179299540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:07:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a8eef5af-5013-442d-bb31-00a056850061 tempest-AttachVolumeTestJSON-1179299540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a8eef5af-5013-442d-bb31-00a056850061 tempest-AttachVolumeTestJSON-1179299540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:21 devstack sudo[96682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:07:21 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:22 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a8eef5af-5013-442d-bb31-00a056850061 tempest-AttachVolumeTestJSON-1179299540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.439s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:22 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-a8eef5af-5013-442d-bb31-00a056850061 tempest-AttachVolumeTestJSON-1179299540 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:07:22 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-a8eef5af-5013-442d-bb31-00a056850061 tempest-AttachVolumeTestJSON-1179299540 None] Deleted volume successfully.
Nov 19 13:07:22 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a8eef5af-5013-442d-bb31-00a056850061 tempest-AttachVolumeTestJSON-1179299540 None] Lock "cinder-ee3c1914-a204-4d6b-91ae-916ee2c1584b-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:07:22 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a3ce01e0-bb0b-4d67-ba39-4d8b16e0df20 tempest-VolumesGetTest-563067098 None] Acquiring lock "cinder-dcef2492-58e0-464c-b328-48b7c3459b86-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:07:22 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a3ce01e0-bb0b-4d67-ba39-4d8b16e0df20 tempest-VolumesGetTest-563067098 None] Lock "cinder-dcef2492-58e0-464c-b328-48b7c3459b86-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:07:22 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a3ce01e0-bb0b-4d67-ba39-4d8b16e0df20 tempest-VolumesGetTest-563067098 None] Acquiring lock "cinder-quobyte-dcef2492-58e0-464c-b328-48b7c3459b86" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:07:22 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a3ce01e0-bb0b-4d67-ba39-4d8b16e0df20 tempest-VolumesGetTest-563067098 None] Lock "cinder-quobyte-dcef2492-58e0-464c-b328-48b7c3459b86" acquired by "delete_volume" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:07:22 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5343c05b-84cd-4fd9-9993-8dd2edea3040]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:07:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a3ce01e0-bb0b-4d67-ba39-4d8b16e0df20 tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dcef2492-58e0-464c-b328-48b7c3459b86 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:22 devstack sudo[96685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dcef2492-58e0-464c-b328-48b7c3459b86
Nov 19 13:07:22 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:22 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a3ce01e0-bb0b-4d67-ba39-4d8b16e0df20 tempest-VolumesGetTest-563067098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dcef2492-58e0-464c-b328-48b7c3459b86" returned: 0 in 0.580s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a3ce01e0-bb0b-4d67-ba39-4d8b16e0df20 tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dcef2492-58e0-464c-b328-48b7c3459b86 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:22 devstack sudo[96691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dcef2492-58e0-464c-b328-48b7c3459b86
Nov 19 13:07:22 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:23 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a3ce01e0-bb0b-4d67-ba39-4d8b16e0df20 tempest-VolumesGetTest-563067098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dcef2492-58e0-464c-b328-48b7c3459b86" returned: 0 in 0.486s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a3ce01e0-bb0b-4d67-ba39-4d8b16e0df20 tempest-VolumesGetTest-563067098 None] Lock "cinder-quobyte-dcef2492-58e0-464c-b328-48b7c3459b86" released by "delete_volume" :: held 1.097s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:07:23 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-a3ce01e0-bb0b-4d67-ba39-4d8b16e0df20 tempest-VolumesGetTest-563067098 None] Created reservations ['17c99d2d-f96a-45af-9c66-fa57e83295ec', '2cfa92de-1ae2-421c-bcbe-e1c26dc566c7', 'f42404c6-57d1-4a78-b40f-af856453cf8e', 'b1b14086-8a40-47d5-9e6b-8db6e000bbfd'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:07:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a3ce01e0-bb0b-4d67-ba39-4d8b16e0df20 tempest-VolumesGetTest-563067098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a3ce01e0-bb0b-4d67-ba39-4d8b16e0df20 tempest-VolumesGetTest-563067098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a3ce01e0-bb0b-4d67-ba39-4d8b16e0df20 tempest-VolumesGetTest-563067098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:07:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a3ce01e0-bb0b-4d67-ba39-4d8b16e0df20 tempest-VolumesGetTest-563067098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:07:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a3ce01e0-bb0b-4d67-ba39-4d8b16e0df20 tempest-VolumesGetTest-563067098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a3ce01e0-bb0b-4d67-ba39-4d8b16e0df20 tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:23 devstack sudo[96694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:07:23 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:24 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a3ce01e0-bb0b-4d67-ba39-4d8b16e0df20 tempest-VolumesGetTest-563067098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.541s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:24 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-a3ce01e0-bb0b-4d67-ba39-4d8b16e0df20 tempest-VolumesGetTest-563067098 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:07:24 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-a3ce01e0-bb0b-4d67-ba39-4d8b16e0df20 tempest-VolumesGetTest-563067098 None] Deleted volume successfully.
Nov 19 13:07:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a3ce01e0-bb0b-4d67-ba39-4d8b16e0df20 tempest-VolumesGetTest-563067098 None] Lock "cinder-dcef2492-58e0-464c-b328-48b7c3459b86-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:07:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-91f35546-54ab-4e0a-9a6d-ddc1169109e5 tempest-VolumesGetTest-563067098 None] Acquiring lock "cinder-04ee5bdd-35ca-403e-893a-3a46035877ff-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:07:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-91f35546-54ab-4e0a-9a6d-ddc1169109e5 tempest-VolumesGetTest-563067098 None] Lock "cinder-04ee5bdd-35ca-403e-893a-3a46035877ff-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:07:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-91f35546-54ab-4e0a-9a6d-ddc1169109e5 tempest-VolumesGetTest-563067098 None] Acquiring lock "cinder-quobyte-04ee5bdd-35ca-403e-893a-3a46035877ff" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:07:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-91f35546-54ab-4e0a-9a6d-ddc1169109e5 tempest-VolumesGetTest-563067098 None] Lock "cinder-quobyte-04ee5bdd-35ca-403e-893a-3a46035877ff" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:07:24 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca34c1f5-dc5d-4205-a3db-8450fd7f2d3e]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:07:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-91f35546-54ab-4e0a-9a6d-ddc1169109e5 tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-04ee5bdd-35ca-403e-893a-3a46035877ff {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:24 devstack sudo[96698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-04ee5bdd-35ca-403e-893a-3a46035877ff
Nov 19 13:07:24 devstack sudo[96698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:25 devstack sudo[96698]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-91f35546-54ab-4e0a-9a6d-ddc1169109e5 tempest-VolumesGetTest-563067098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-04ee5bdd-35ca-403e-893a-3a46035877ff" returned: 0 in 0.611s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-91f35546-54ab-4e0a-9a6d-ddc1169109e5 tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-04ee5bdd-35ca-403e-893a-3a46035877ff {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:25 devstack sudo[96703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-04ee5bdd-35ca-403e-893a-3a46035877ff
Nov 19 13:07:25 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:25 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-91f35546-54ab-4e0a-9a6d-ddc1169109e5 tempest-VolumesGetTest-563067098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-04ee5bdd-35ca-403e-893a-3a46035877ff" returned: 0 in 0.541s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-91f35546-54ab-4e0a-9a6d-ddc1169109e5 tempest-VolumesGetTest-563067098 None] Lock "cinder-quobyte-04ee5bdd-35ca-403e-893a-3a46035877ff" released by "delete_volume" :: held 1.186s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:07:25 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-91f35546-54ab-4e0a-9a6d-ddc1169109e5 tempest-VolumesGetTest-563067098 None] Created reservations ['510a37b1-e6db-4fed-8ff6-6381af66b60c', '9e68f8af-5c19-4280-9a87-6b4534c28492', '483405c5-a7e0-4e55-9b93-d7731cf78d84', '55797d0b-2153-4e28-b00e-9896063cf224'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:07:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-91f35546-54ab-4e0a-9a6d-ddc1169109e5 tempest-VolumesGetTest-563067098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-91f35546-54ab-4e0a-9a6d-ddc1169109e5 tempest-VolumesGetTest-563067098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:25 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-91f35546-54ab-4e0a-9a6d-ddc1169109e5 tempest-VolumesGetTest-563067098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:07:25 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-91f35546-54ab-4e0a-9a6d-ddc1169109e5 tempest-VolumesGetTest-563067098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:07:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-91f35546-54ab-4e0a-9a6d-ddc1169109e5 tempest-VolumesGetTest-563067098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-91f35546-54ab-4e0a-9a6d-ddc1169109e5 tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:25 devstack sudo[96707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:07:25 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:26 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-91f35546-54ab-4e0a-9a6d-ddc1169109e5 tempest-VolumesGetTest-563067098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.550s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:26 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-91f35546-54ab-4e0a-9a6d-ddc1169109e5 tempest-VolumesGetTest-563067098 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:07:26 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-91f35546-54ab-4e0a-9a6d-ddc1169109e5 tempest-VolumesGetTest-563067098 None] Deleted volume successfully.
Nov 19 13:07:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-91f35546-54ab-4e0a-9a6d-ddc1169109e5 tempest-VolumesGetTest-563067098 None] Lock "cinder-04ee5bdd-35ca-403e-893a-3a46035877ff-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:07:26 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-aa49c266-5d1c-42d9-8843-9e69713d2f31 req-9f302486-c1db-426c-815d-c70413b196c8 tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Terminate volume connection completed successfully.
Nov 19 13:07:26 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-aa49c266-5d1c-42d9-8843-9e69713d2f31 req-9f302486-c1db-426c-815d-c70413b196c8 tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Deleting attachment a2525782-ca81-431b-b3d8-d657fe3fe0f8. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 13:07:27 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:07:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Flow 'volume_create_manager' (c6644413-b78b-453a-a6c8-653e01f7fb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:07:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (104e0c29-9442-4aaa-88fa-a1e7f08cc6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (104e0c29-9442-4aaa-88fa-a1e7f08cc6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-765231789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a57abfc-8d7e-4e41-9b26-38eb16ffb50d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a0e8cd3382e2413c8fd0613b9d668a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:07:27Z,use_quota=True,user_id='943500ec6e95493e97f474f3907dbdba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cbf51a2-686b-49c8-96f8-5172e514419c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cbf51a2-686b-49c8-96f8-5172e514419c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50f065ef-c4c9-4471-afa8-aa92c4941907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:27 devstack cinder-volume[80839]: DEBUG cinder.image.glance [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Creating Keystone auth plugin from conf {{(pid=80839) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Nov 19 13:07:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50f065ef-c4c9-4471-afa8-aa92c4941907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4a57abfc-8d7e-4e41-9b26-38eb16ffb50d', 'volume_name': 'volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d', 'volume_size': 1, 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb13a00dd9444268988d63a8279e0575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5d491c17-c417-4a2b-886e-ad2958917626', 'created_at': datetime.datetime(2025, 11, 19, 11, 46, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 19, 11, 46, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d491c17-c417-4a2b-886e-ad2958917626/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbd13e6ee60>}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a33af9-99a7-4f0b-98c4-2f2890e609e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a33af9-99a7-4f0b-98c4-2f2890e609e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a40513ce-0979-43b1-bf65-8fd247816a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:27 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Volume 4a57abfc-8d7e-4e41-9b26-38eb16ffb50d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d', 'volume_size': 1, 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb13a00dd9444268988d63a8279e0575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5d491c17-c417-4a2b-886e-ad2958917626', 'created_at': datetime.datetime(2025, 11, 19, 11, 46, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 19, 11, 46, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d491c17-c417-4a2b-886e-ad2958917626/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbd13e6ee60>}
Nov 19 13:07:27 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Cloning 4a57abfc-8d7e-4e41-9b26-38eb16ffb50d from image 5d491c17-c417-4a2b-886e-ad2958917626  at location (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]). {{(pid=80839) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Nov 19 13:07:27 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_lo1d4ncadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=80839) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Nov 19 13:07:27 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Image download 20.69 MB at 20.69 MB/s
Nov 19 13:07:27 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53c19b0-5872-488d-83f1-dd76ede3ed9f]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:07:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_lo1d4ncadevstack@QuobyteHD {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:27 devstack sudo[96738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_lo1d4ncadevstack@QuobyteHD
Nov 19 13:07:27 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:27 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c4a3cac7-da59-4ad4-a207-887a3c861b42 tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Acquiring lock "cinder-983efcf5-5f94-46ac-830c-86ce7ee876c6-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:07:27 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c4a3cac7-da59-4ad4-a207-887a3c861b42 tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Lock "cinder-983efcf5-5f94-46ac-830c-86ce7ee876c6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:07:27 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c4a3cac7-da59-4ad4-a207-887a3c861b42 tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Acquiring lock "cinder-quobyte-983efcf5-5f94-46ac-830c-86ce7ee876c6" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:07:27 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c4a3cac7-da59-4ad4-a207-887a3c861b42 tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Lock "cinder-quobyte-983efcf5-5f94-46ac-830c-86ce7ee876c6" acquired by "delete_volume" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:07:28 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29ebfea-23d8-47e5-9b6c-294c1dc99440]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:07:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c4a3cac7-da59-4ad4-a207-887a3c861b42 tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-983efcf5-5f94-46ac-830c-86ce7ee876c6 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:28 devstack sudo[96740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-983efcf5-5f94-46ac-830c-86ce7ee876c6
Nov 19 13:07:28 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:28 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_lo1d4ncadevstack@QuobyteHD" returned: 0 in 0.577s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:28 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Temporary image 5d491c17-c417-4a2b-886e-ad2958917626 is fetched for user 943500ec6e95493e97f474f3907dbdba. {{(pid=80839) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Nov 19 13:07:28 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d9b373-c407-4e8d-9fd2-898975b1ef9a]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:07:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_lo1d4ncadevstack@QuobyteHD {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:28 devstack sudo[96745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_lo1d4ncadevstack@QuobyteHD
Nov 19 13:07:28 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:28 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c4a3cac7-da59-4ad4-a207-887a3c861b42 tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-983efcf5-5f94-46ac-830c-86ce7ee876c6" returned: 0 in 0.646s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c4a3cac7-da59-4ad4-a207-887a3c861b42 tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-983efcf5-5f94-46ac-830c-86ce7ee876c6 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:28 devstack sudo[96754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-983efcf5-5f94-46ac-830c-86ce7ee876c6
Nov 19 13:07:28 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:28 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_lo1d4ncadevstack@QuobyteHD" returned: 0 in 0.577s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-765231789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a57abfc-8d7e-4e41-9b26-38eb16ffb50d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a0e8cd3382e2413c8fd0613b9d668a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:07:27Z,use_quota=True,user_id='943500ec6e95493e97f474f3907dbdba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:07:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Creating volume 4a57abfc-8d7e-4e41-9b26-38eb16ffb50d {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:07:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:07:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:07:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:07:28 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:07:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:28 devstack sudo[96759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d 1073741824
Nov 19 13:07:28 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:29 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c4a3cac7-da59-4ad4-a207-887a3c861b42 tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-983efcf5-5f94-46ac-830c-86ce7ee876c6" returned: 0 in 0.477s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:29 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c4a3cac7-da59-4ad4-a207-887a3c861b42 tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Lock "cinder-quobyte-983efcf5-5f94-46ac-830c-86ce7ee876c6" released by "delete_volume" :: held 1.164s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:07:29 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-c4a3cac7-da59-4ad4-a207-887a3c861b42 tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Created reservations ['a4b94ce3-47fa-4cf0-9732-6be0a2089321', 'd9e55749-e806-4a4f-b338-b24f7fc9fdd9', '2228afbb-98df-4143-8a83-bd1eddd411e2', '05c1a7ab-f628-42d1-86e1-e4575b21ae89'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:07:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c4a3cac7-da59-4ad4-a207-887a3c861b42 tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c4a3cac7-da59-4ad4-a207-887a3c861b42 tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:29 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c4a3cac7-da59-4ad4-a207-887a3c861b42 tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:07:29 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c4a3cac7-da59-4ad4-a207-887a3c861b42 tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:07:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c4a3cac7-da59-4ad4-a207-887a3c861b42 tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c4a3cac7-da59-4ad4-a207-887a3c861b42 tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:29 devstack sudo[96762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:07:29 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:29 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d 1073741824" returned: 0 in 0.588s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:29 devstack sudo[96767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d
Nov 19 13:07:29 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:29 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c4a3cac7-da59-4ad4-a207-887a3c861b42 tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.491s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:29 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-c4a3cac7-da59-4ad4-a207-887a3c861b42 tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:07:29 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-c4a3cac7-da59-4ad4-a207-887a3c861b42 tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Deleted volume successfully.
Nov 19 13:07:29 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c4a3cac7-da59-4ad4-a207-887a3c861b42 tempest-TestServerVolumeAttachScenarioOldVersion-21128675 None] Lock "cinder-983efcf5-5f94-46ac-830c-86ce7ee876c6-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:07:29 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d" returned: 0 in 0.455s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:29 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:07:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:29 devstack cinder-volume[80839]: DEBUG cinder.volume.volume_utils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Attempting download of 5d491c17-c417-4a2b-886e-ad2958917626 ((None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}])) to volume 4a57abfc-8d7e-4e41-9b26-38eb16ffb50d. {{(pid=80839) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Nov 19 13:07:29 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af58403-0525-4d11-a042-8c864207ca00]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:07:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_30d4pgpn {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:30 devstack sudo[96771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_30d4pgpn
Nov 19 13:07:30 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:30 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_30d4pgpn" returned: 0 in 0.616s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_30d4pgpn {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:30 devstack sudo[96775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_30d4pgpn
Nov 19 13:07:30 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:31 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_30d4pgpn" returned: 1 in 0.584s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_30d4pgpn' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 13:07:31 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b195fe50-e431-4f04-94cb-dea3ec420315]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:07:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_lo1d4ncadevstack@QuobyteHD {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:31 devstack sudo[96779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_lo1d4ncadevstack@QuobyteHD
Nov 19 13:07:31 devstack sudo[96779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:31 devstack sudo[96779]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_lo1d4ncadevstack@QuobyteHD" returned: 0 in 0.645s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:31 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] 5d491c17-c417-4a2b-886e-ad2958917626 was qcow2, converting to raw {{(pid=80839) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Nov 19 13:07:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_lo1d4ncadevstack@QuobyteHD /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:31 devstack sudo[96816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_lo1d4ncadevstack@QuobyteHD /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d
Nov 19 13:07:31 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:32 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_lo1d4ncadevstack@QuobyteHD /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d" returned: 0 in 1.127s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:32 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_lo1d4ncadevstack@QuobyteHD, size 112.00 MB, duration 1.13 sec, destination /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d {{(pid=80839) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 19 13:07:32 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Converted 112.00 MB image at 99.23 MB/s
Nov 19 13:07:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:32 devstack sudo[96834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d 1G
Nov 19 13:07:32 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:33 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d 1G" returned: 0 in 0.626s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:33 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bd2240-74e3-4006-9c04-1e378e0a123b]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:07:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:33 devstack sudo[96841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d
Nov 19 13:07:33 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:34 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d" returned: 0 in 0.634s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:34 devstack sudo[96846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d
Nov 19 13:07:34 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:34 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d" returned: 1 in 0.663s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 13:07:34 devstack cinder-volume[80839]: DEBUG cinder.volume.volume_utils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Downloaded image 5d491c17-c417-4a2b-886e-ad2958917626 ((None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}])) to volume 4a57abfc-8d7e-4e41-9b26-38eb16ffb50d successfully. {{(pid=80839) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Nov 19 13:07:34 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Temporary image 5d491c17-c417-4a2b-886e-ad2958917626 for user 943500ec6e95493e97f474f3907dbdba is deleted. {{(pid=80839) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Nov 19 13:07:34 devstack cinder-volume[80839]: DEBUG cinder.volume.volume_utils [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Marking volume 4a57abfc-8d7e-4e41-9b26-38eb16ffb50d as bootable. {{(pid=80839) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Nov 19 13:07:34 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Copying metadata from image 5d491c17-c417-4a2b-886e-ad2958917626 to 4a57abfc-8d7e-4e41-9b26-38eb16ffb50d. {{(pid=80839) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 19 13:07:34 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Creating volume glance metadata for volume 4a57abfc-8d7e-4e41-9b26-38eb16ffb50d backed by image 5d491c17-c417-4a2b-886e-ad2958917626 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=80839) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 19 13:07:34 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a40513ce-0979-43b1-bf65-8fd247816a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d', 'volume_size': 1, 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb13a00dd9444268988d63a8279e0575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5d491c17-c417-4a2b-886e-ad2958917626', 'created_at': datetime.datetime(2025, 11, 19, 11, 46, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 19, 11, 46, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d491c17-c417-4a2b-886e-ad2958917626/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbd13e6ee60>}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:34 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e931a5a3-c6b1-4456-834b-8fcc353052ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:34 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Volume volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d (4a57abfc-8d7e-4e41-9b26-38eb16ffb50d): created successfully
Nov 19 13:07:35 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e931a5a3-c6b1-4456-834b-8fcc353052ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:35 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Flow 'volume_create_manager' (c6644413-b78b-453a-a6c8-653e01f7fb6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:07:35 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-8dcb95da-2ccc-44d5-ba85-98285241c15d tempest-VolumesGetTest-563067098 None] Created volume successfully.
Nov 19 13:07:36 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:07:36 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Flow 'volume_create_manager' (fd0b559b-72d3-4bce-9ce0-e0b7757b32c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:07:36 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed42c30b-dac2-487f-ae60-336f4098f48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:36 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed42c30b-dac2-487f-ae60-336f4098f48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:07:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1270220109',display_name='tempest-VolumesGetTest-Volume-616010968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f9a70e-7d86-4651-8cce-364da207b994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e8cd3382e2413c8fd0613b9d668a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:07:36Z,use_quota=True,user_id='943500ec6e95493e97f474f3907dbdba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:36 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ac4cc0-fa11-4099-9daf-f3283ac8494d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:36 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ac4cc0-fa11-4099-9daf-f3283ac8494d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:36 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d54b477-7a11-4b99-a0f1-218892b27801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:36 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d54b477-7a11-4b99-a0f1-218892b27801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80f9a70e-7d86-4651-8cce-364da207b994', 'volume_name': 'volume-80f9a70e-7d86-4651-8cce-364da207b994', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:36 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d12599-63aa-4b49-8ed4-06e6cc70c905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:36 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d12599-63aa-4b49-8ed4-06e6cc70c905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:36 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd7b65b-403d-48ea-b9e2-a64a40cdd6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:36 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Volume 80f9a70e-7d86-4651-8cce-364da207b994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80f9a70e-7d86-4651-8cce-364da207b994', 'volume_size': 1}
Nov 19 13:07:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:36 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:07:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1270220109',display_name='tempest-VolumesGetTest-Volume-616010968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f9a70e-7d86-4651-8cce-364da207b994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0e8cd3382e2413c8fd0613b9d668a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:07:36Z,use_quota=True,user_id='943500ec6e95493e97f474f3907dbdba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:07:36 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Creating volume 80f9a70e-7d86-4651-8cce-364da207b994 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:07:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:36 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:07:36 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:07:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:36 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:07:36 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:07:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-80f9a70e-7d86-4651-8cce-364da207b994 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:36 devstack sudo[96893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-80f9a70e-7d86-4651-8cce-364da207b994 1073741824
Nov 19 13:07:36 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:36 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-80f9a70e-7d86-4651-8cce-364da207b994 1073741824" returned: 0 in 0.605s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-80f9a70e-7d86-4651-8cce-364da207b994 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:36 devstack sudo[96898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-80f9a70e-7d86-4651-8cce-364da207b994
Nov 19 13:07:36 devstack sudo[96898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:37 devstack sudo[96898]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-80f9a70e-7d86-4651-8cce-364da207b994" returned: 0 in 0.456s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:37 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:07:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd7b65b-403d-48ea-b9e2-a64a40cdd6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80f9a70e-7d86-4651-8cce-364da207b994', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5088be2-3e99-416c-81ce-aefe4ec150e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:37 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Volume volume-80f9a70e-7d86-4651-8cce-364da207b994 (80f9a70e-7d86-4651-8cce-364da207b994): created successfully
Nov 19 13:07:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5088be2-3e99-416c-81ce-aefe4ec150e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Flow 'volume_create_manager' (fd0b559b-72d3-4bce-9ce0-e0b7757b32c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:07:37 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-6938fbd9-011d-4ab8-8943-ed098c80f021 tempest-VolumesGetTest-563067098 None] Created volume successfully.
Nov 19 13:07:38 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9db1da06-a263-4656-993e-df0ff230303c tempest-VolumesGetTest-563067098 None] Acquiring lock "cinder-80f9a70e-7d86-4651-8cce-364da207b994-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:07:38 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9db1da06-a263-4656-993e-df0ff230303c tempest-VolumesGetTest-563067098 None] Lock "cinder-80f9a70e-7d86-4651-8cce-364da207b994-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:07:38 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9db1da06-a263-4656-993e-df0ff230303c tempest-VolumesGetTest-563067098 None] Acquiring lock "cinder-quobyte-80f9a70e-7d86-4651-8cce-364da207b994" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:07:38 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9db1da06-a263-4656-993e-df0ff230303c tempest-VolumesGetTest-563067098 None] Lock "cinder-quobyte-80f9a70e-7d86-4651-8cce-364da207b994" acquired by "delete_volume" :: waited 0.013s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:07:38 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c7e5bb-ad33-42ce-8aab-672c10652e51]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:07:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9db1da06-a263-4656-993e-df0ff230303c tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-80f9a70e-7d86-4651-8cce-364da207b994 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:38 devstack sudo[96902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-80f9a70e-7d86-4651-8cce-364da207b994
Nov 19 13:07:38 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:39 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9db1da06-a263-4656-993e-df0ff230303c tempest-VolumesGetTest-563067098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-80f9a70e-7d86-4651-8cce-364da207b994" returned: 0 in 0.653s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9db1da06-a263-4656-993e-df0ff230303c tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-80f9a70e-7d86-4651-8cce-364da207b994 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:39 devstack sudo[96907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-80f9a70e-7d86-4651-8cce-364da207b994
Nov 19 13:07:39 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:39 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9db1da06-a263-4656-993e-df0ff230303c tempest-VolumesGetTest-563067098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-80f9a70e-7d86-4651-8cce-364da207b994" returned: 0 in 0.534s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:39 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9db1da06-a263-4656-993e-df0ff230303c tempest-VolumesGetTest-563067098 None] Lock "cinder-quobyte-80f9a70e-7d86-4651-8cce-364da207b994" released by "delete_volume" :: held 1.209s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:07:39 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-9db1da06-a263-4656-993e-df0ff230303c tempest-VolumesGetTest-563067098 None] Created reservations ['ef4eaa69-a084-4ab8-80ef-ccc5cc14a0ce', '8c65c793-b190-4fe2-b796-3aa37246e5b7', '9a7f132a-39e4-4322-a475-c0ad22248121', 'a537a3df-873f-44f3-9ebb-7a12f1d6d881'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:07:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9db1da06-a263-4656-993e-df0ff230303c tempest-VolumesGetTest-563067098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9db1da06-a263-4656-993e-df0ff230303c tempest-VolumesGetTest-563067098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:39 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-9db1da06-a263-4656-993e-df0ff230303c tempest-VolumesGetTest-563067098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:07:39 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-9db1da06-a263-4656-993e-df0ff230303c tempest-VolumesGetTest-563067098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:07:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9db1da06-a263-4656-993e-df0ff230303c tempest-VolumesGetTest-563067098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9db1da06-a263-4656-993e-df0ff230303c tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:39 devstack sudo[96912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:07:39 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:40 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9db1da06-a263-4656-993e-df0ff230303c tempest-VolumesGetTest-563067098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.520s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:40 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-9db1da06-a263-4656-993e-df0ff230303c tempest-VolumesGetTest-563067098 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:07:40 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-9db1da06-a263-4656-993e-df0ff230303c tempest-VolumesGetTest-563067098 None] Deleted volume successfully.
Nov 19 13:07:40 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9db1da06-a263-4656-993e-df0ff230303c tempest-VolumesGetTest-563067098 None] Lock "cinder-80f9a70e-7d86-4651-8cce-364da207b994-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:07:40 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-3e0667a8-63b3-4bde-bf4c-c41c44f781fd tempest-VolumesGetTest-563067098 None] Acquiring lock "cinder-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:07:40 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-3e0667a8-63b3-4bde-bf4c-c41c44f781fd tempest-VolumesGetTest-563067098 None] Lock "cinder-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:07:40 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-3e0667a8-63b3-4bde-bf4c-c41c44f781fd tempest-VolumesGetTest-563067098 None] Acquiring lock "cinder-quobyte-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:07:40 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-3e0667a8-63b3-4bde-bf4c-c41c44f781fd tempest-VolumesGetTest-563067098 None] Lock "cinder-quobyte-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d" acquired by "delete_volume" :: waited 0.012s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:07:40 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[52071aeb-eaa4-4370-928f-32d34ced8bfe]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:07:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3e0667a8-63b3-4bde-bf4c-c41c44f781fd tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:40 devstack sudo[96915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d
Nov 19 13:07:40 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:41 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3e0667a8-63b3-4bde-bf4c-c41c44f781fd tempest-VolumesGetTest-563067098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d" returned: 0 in 0.635s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3e0667a8-63b3-4bde-bf4c-c41c44f781fd tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:41 devstack sudo[96920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d
Nov 19 13:07:41 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:41 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3e0667a8-63b3-4bde-bf4c-c41c44f781fd tempest-VolumesGetTest-563067098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d" returned: 1 in 0.617s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3e0667a8-63b3-4bde-bf4c-c41c44f781fd tempest-VolumesGetTest-563067098 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 13:07:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3e0667a8-63b3-4bde-bf4c-c41c44f781fd tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:41 devstack sudo[96926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d
Nov 19 13:07:41 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:42 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3e0667a8-63b3-4bde-bf4c-c41c44f781fd tempest-VolumesGetTest-563067098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d" returned: 0 in 0.452s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:42 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-3e0667a8-63b3-4bde-bf4c-c41c44f781fd tempest-VolumesGetTest-563067098 None] Lock "cinder-quobyte-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d" released by "delete_volume" :: held 1.755s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:07:42 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-3e0667a8-63b3-4bde-bf4c-c41c44f781fd tempest-VolumesGetTest-563067098 None] Created reservations ['303a7d38-7bb4-4354-a433-8547c3088a39', '7e7256bb-094a-48c0-becc-311c943100f9', '865114d7-bbd7-416b-8048-49920dea242b', '63d1e9cf-4fec-469f-995b-6bcb036ba54f'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:07:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3e0667a8-63b3-4bde-bf4c-c41c44f781fd tempest-VolumesGetTest-563067098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3e0667a8-63b3-4bde-bf4c-c41c44f781fd tempest-VolumesGetTest-563067098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3e0667a8-63b3-4bde-bf4c-c41c44f781fd tempest-VolumesGetTest-563067098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:07:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3e0667a8-63b3-4bde-bf4c-c41c44f781fd tempest-VolumesGetTest-563067098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:07:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3e0667a8-63b3-4bde-bf4c-c41c44f781fd tempest-VolumesGetTest-563067098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3e0667a8-63b3-4bde-bf4c-c41c44f781fd tempest-VolumesGetTest-563067098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:42 devstack sudo[96939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:07:42 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:43 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3e0667a8-63b3-4bde-bf4c-c41c44f781fd tempest-VolumesGetTest-563067098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.527s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:43 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-3e0667a8-63b3-4bde-bf4c-c41c44f781fd tempest-VolumesGetTest-563067098 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:07:43 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-3e0667a8-63b3-4bde-bf4c-c41c44f781fd tempest-VolumesGetTest-563067098 None] Deleted volume successfully.
Nov 19 13:07:43 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-3e0667a8-63b3-4bde-bf4c-c41c44f781fd tempest-VolumesGetTest-563067098 None] Lock "cinder-4a57abfc-8d7e-4e41-9b26-38eb16ffb50d-delete_volume" released by "delete_volume" :: held 2.451s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:07:44 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:07:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Flow 'volume_create_manager' (5a95b59d-6a8f-44bb-8bbd-197fdeb7376d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:07:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf87131d-07f1-4b50-a2ad-380b73fb69be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf87131d-07f1-4b50-a2ad-380b73fb69be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1173781589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f822bfcc-8789-44bb-8c22-c22f2f90ec06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e028fe687a4746bf82c1ca26aa2cb3fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:07:45Z,use_quota=True,user_id='b9398a9fb0d04fc08470c4d20a7ef12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f934d1e-10d4-47a9-99e2-150ab5796599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f934d1e-10d4-47a9-99e2-150ab5796599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5a46bc-5813-498a-bf30-db9352310363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5a46bc-5813-498a-bf30-db9352310363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f822bfcc-8789-44bb-8c22-c22f2f90ec06', 'volume_name': 'volume-f822bfcc-8789-44bb-8c22-c22f2f90ec06', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e337f3-9734-4967-b2e8-63090a9b2884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e337f3-9734-4967-b2e8-63090a9b2884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (032fd97f-5ef1-4764-a07f-94dfd2a06edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:44 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Volume f822bfcc-8789-44bb-8c22-c22f2f90ec06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f822bfcc-8789-44bb-8c22-c22f2f90ec06', 'volume_size': 1}
Nov 19 13:07:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:44 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1173781589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f822bfcc-8789-44bb-8c22-c22f2f90ec06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e028fe687a4746bf82c1ca26aa2cb3fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:07:45Z,use_quota=True,user_id='b9398a9fb0d04fc08470c4d20a7ef12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:07:44 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Creating volume f822bfcc-8789-44bb-8c22-c22f2f90ec06 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:07:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:44 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:07:44 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:07:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:44 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:07:44 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:07:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-f822bfcc-8789-44bb-8c22-c22f2f90ec06 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:44 devstack sudo[96950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-f822bfcc-8789-44bb-8c22-c22f2f90ec06 1073741824
Nov 19 13:07:44 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:45 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-f822bfcc-8789-44bb-8c22-c22f2f90ec06 1073741824" returned: 0 in 0.642s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-f822bfcc-8789-44bb-8c22-c22f2f90ec06 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:45 devstack sudo[96955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-f822bfcc-8789-44bb-8c22-c22f2f90ec06
Nov 19 13:07:45 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:46 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-f822bfcc-8789-44bb-8c22-c22f2f90ec06" returned: 0 in 0.513s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (032fd97f-5ef1-4764-a07f-94dfd2a06edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f822bfcc-8789-44bb-8c22-c22f2f90ec06', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6260fb7b-ead0-425c-b388-a5bca9d885f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:46 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Volume volume-f822bfcc-8789-44bb-8c22-c22f2f90ec06 (f822bfcc-8789-44bb-8c22-c22f2f90ec06): created successfully
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6260fb7b-ead0-425c-b388-a5bca9d885f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Flow 'volume_create_manager' (5a95b59d-6a8f-44bb-8bbd-197fdeb7376d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:07:46 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-0b4f3397-a152-4239-bdb7-908bd86c7f1f tempest-VolumesNegativeTest-392285953 None] Created volume successfully.
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Flow 'volume_create_manager' (6e0a88b7-cbbd-4855-a167-bd96c5b2758c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f43e140-e222-4603-8069-4d368c3ae1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f43e140-e222-4603-8069-4d368c3ae1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88cdb30a-c19a-48de-9b28-5f077cf21d7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3d82a2bfd4a479b9c61870f283099e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:07:47Z,use_quota=True,user_id='faf4433a41314b02a3e33403e99860e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6e9bd3-afa8-476f-86a8-5e8d26c82209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6e9bd3-afa8-476f-86a8-5e8d26c82209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed92d390-1121-4b02-8e2e-4e978965a56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed92d390-1121-4b02-8e2e-4e978965a56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88cdb30a-c19a-48de-9b28-5f077cf21d7b', 'volume_name': 'volume-88cdb30a-c19a-48de-9b28-5f077cf21d7b', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de924375-ef80-4f72-b399-5fad7257cfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de924375-ef80-4f72-b399-5fad7257cfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27d36fe-642e-4309-8709-8c8efcb6b822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:46 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Volume 88cdb30a-c19a-48de-9b28-5f077cf21d7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88cdb30a-c19a-48de-9b28-5f077cf21d7b', 'volume_size': 1}
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88cdb30a-c19a-48de-9b28-5f077cf21d7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3d82a2bfd4a479b9c61870f283099e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:07:47Z,use_quota=True,user_id='faf4433a41314b02a3e33403e99860e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Creating volume 88cdb30a-c19a-48de-9b28-5f077cf21d7b {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:07:46 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:07:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-88cdb30a-c19a-48de-9b28-5f077cf21d7b 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:47 devstack sudo[96961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-88cdb30a-c19a-48de-9b28-5f077cf21d7b 1073741824
Nov 19 13:07:47 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:48 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-88cdb30a-c19a-48de-9b28-5f077cf21d7b 1073741824" returned: 0 in 1.039s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-88cdb30a-c19a-48de-9b28-5f077cf21d7b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:48 devstack sudo[97027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-88cdb30a-c19a-48de-9b28-5f077cf21d7b
Nov 19 13:07:48 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:48 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-88cdb30a-c19a-48de-9b28-5f077cf21d7b" returned: 0 in 0.559s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:48 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:07:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27d36fe-642e-4309-8709-8c8efcb6b822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88cdb30a-c19a-48de-9b28-5f077cf21d7b', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67214517-2cf3-43bc-a037-3ba3a63958eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:48 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Volume volume-88cdb30a-c19a-48de-9b28-5f077cf21d7b (88cdb30a-c19a-48de-9b28-5f077cf21d7b): created successfully
Nov 19 13:07:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67214517-2cf3-43bc-a037-3ba3a63958eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Flow 'volume_create_manager' (6e0a88b7-cbbd-4855-a167-bd96c5b2758c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:07:48 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-3b160979-a3b0-4771-aed8-f1231929559f tempest-CinderUnicodeTest-1235186117 None] Created volume successfully.
Nov 19 13:07:49 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:07:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Flow 'volume_create_manager' (a36da919-6a13-494a-b9b0-8d55588e9f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:07:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67bf913c-852c-4238-92ba-f527c21ffda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67bf913c-852c-4238-92ba-f527c21ffda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:07:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-79035407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59bb5fda-6d8b-4a94-b14f-07b593402901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3d82a2bfd4a479b9c61870f283099e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:07:49Z,use_quota=True,user_id='faf4433a41314b02a3e33403e99860e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82995a64-84ab-4418-9358-dcb0f841a7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82995a64-84ab-4418-9358-dcb0f841a7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bda1c1a-162c-4e0e-828c-d6a4ef5fd826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bda1c1a-162c-4e0e-828c-d6a4ef5fd826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59bb5fda-6d8b-4a94-b14f-07b593402901', 'volume_name': 'volume-59bb5fda-6d8b-4a94-b14f-07b593402901', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1009956b-dc71-4fd7-9eb5-134ce13cc32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1009956b-dc71-4fd7-9eb5-134ce13cc32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d645d8-d379-4cac-99e7-bf4f5a9cd184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:49 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Volume 59bb5fda-6d8b-4a94-b14f-07b593402901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59bb5fda-6d8b-4a94-b14f-07b593402901', 'volume_size': 1}
Nov 19 13:07:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:49 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:07:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-79035407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59bb5fda-6d8b-4a94-b14f-07b593402901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3d82a2bfd4a479b9c61870f283099e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:07:49Z,use_quota=True,user_id='faf4433a41314b02a3e33403e99860e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:07:49 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Creating volume 59bb5fda-6d8b-4a94-b14f-07b593402901 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:07:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:49 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:07:49 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:07:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:49 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:07:49 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:07:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:49 devstack sudo[97030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901 1073741824
Nov 19 13:07:49 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:50 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901 1073741824" returned: 0 in 0.648s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:50 devstack sudo[97035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901
Nov 19 13:07:50 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:50 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901" returned: 0 in 0.530s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:50 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:07:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d645d8-d379-4cac-99e7-bf4f5a9cd184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59bb5fda-6d8b-4a94-b14f-07b593402901', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d27adb7-0eaf-44d1-83e9-79b138f3c464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:07:50 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Volume volume-59bb5fda-6d8b-4a94-b14f-07b593402901 (59bb5fda-6d8b-4a94-b14f-07b593402901): created successfully
Nov 19 13:07:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d27adb7-0eaf-44d1-83e9-79b138f3c464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:07:50 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Flow 'volume_create_manager' (a36da919-6a13-494a-b9b0-8d55588e9f35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:07:50 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-fed7f843-da13-4071-9b73-8fe47ac0524e tempest-CinderUnicodeTest-1235186117 None] Created volume successfully.
Nov 19 13:07:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-55d811da-99dd-4740-96ea-c07d35406c39 tempest-CinderUnicodeTest-1235186117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:07:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-55d811da-99dd-4740-96ea-c07d35406c39 tempest-CinderUnicodeTest-1235186117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:07:51 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-55d811da-99dd-4740-96ea-c07d35406c39 tempest-CinderUnicodeTest-1235186117 None] Creating offline snapshot 6ecdeaa3-70fc-4bc4-9b34-96b976c287fa of volume 59bb5fda-6d8b-4a94-b14f-07b593402901 {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 13:07:51 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cce1889-1b15-4f47-b8f1-01584a66fe02]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:07:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-55d811da-99dd-4740-96ea-c07d35406c39 tempest-CinderUnicodeTest-1235186117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:51 devstack sudo[97040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901
Nov 19 13:07:51 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:52 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-55d811da-99dd-4740-96ea-c07d35406c39 tempest-CinderUnicodeTest-1235186117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901" returned: 0 in 0.608s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-55d811da-99dd-4740-96ea-c07d35406c39 tempest-CinderUnicodeTest-1235186117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901.6ecdeaa3-70fc-4bc4-9b34-96b976c287fa 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:52 devstack sudo[97045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901.6ecdeaa3-70fc-4bc4-9b34-96b976c287fa 1G
Nov 19 13:07:52 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:52 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-55d811da-99dd-4740-96ea-c07d35406c39 tempest-CinderUnicodeTest-1235186117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901.6ecdeaa3-70fc-4bc4-9b34-96b976c287fa 1G" returned: 0 in 0.589s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-55d811da-99dd-4740-96ea-c07d35406c39 tempest-CinderUnicodeTest-1235186117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59bb5fda-6d8b-4a94-b14f-07b593402901 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901.6ecdeaa3-70fc-4bc4-9b34-96b976c287fa {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:52 devstack sudo[97053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59bb5fda-6d8b-4a94-b14f-07b593402901 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901.6ecdeaa3-70fc-4bc4-9b34-96b976c287fa
Nov 19 13:07:52 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:53 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-55d811da-99dd-4740-96ea-c07d35406c39 tempest-CinderUnicodeTest-1235186117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59bb5fda-6d8b-4a94-b14f-07b593402901 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901.6ecdeaa3-70fc-4bc4-9b34-96b976c287fa" returned: 0 in 0.536s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:53 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-55d811da-99dd-4740-96ea-c07d35406c39 tempest-CinderUnicodeTest-1235186117 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901.6ecdeaa3-70fc-4bc4-9b34-96b976c287fa is being set with open permissions: ugo+rw
Nov 19 13:07:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-55d811da-99dd-4740-96ea-c07d35406c39 tempest-CinderUnicodeTest-1235186117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901.6ecdeaa3-70fc-4bc4-9b34-96b976c287fa {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:53 devstack sudo[97058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901.6ecdeaa3-70fc-4bc4-9b34-96b976c287fa
Nov 19 13:07:53 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:53 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-55d811da-99dd-4740-96ea-c07d35406c39 tempest-CinderUnicodeTest-1235186117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901.6ecdeaa3-70fc-4bc4-9b34-96b976c287fa" returned: 0 in 0.582s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-55d811da-99dd-4740-96ea-c07d35406c39 tempest-CinderUnicodeTest-1235186117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:54 devstack sudo[97062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901.info
Nov 19 13:07:54 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:54 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-55d811da-99dd-4740-96ea-c07d35406c39 tempest-CinderUnicodeTest-1235186117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901.info" returned: 0 in 0.511s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:54 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-55d811da-99dd-4740-96ea-c07d35406c39 tempest-CinderUnicodeTest-1235186117 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901.info is being set with open permissions: ugo+rw
Nov 19 13:07:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-55d811da-99dd-4740-96ea-c07d35406c39 tempest-CinderUnicodeTest-1235186117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:54 devstack sudo[97075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901.info
Nov 19 13:07:54 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:54 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-55d811da-99dd-4740-96ea-c07d35406c39 tempest-CinderUnicodeTest-1235186117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901.info" returned: 0 in 0.448s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-55d811da-99dd-4740-96ea-c07d35406c39 tempest-CinderUnicodeTest-1235186117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.338s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:07:54 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-55d811da-99dd-4740-96ea-c07d35406c39 tempest-CinderUnicodeTest-1235186117 None] Create snapshot completed successfully
Nov 19 13:07:55 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6d553d45-6233-4f3a-81e6-88fb9501f58c tempest-CinderUnicodeTest-1235186117 None] Acquiring lock "cinder-6ecdeaa3-70fc-4bc4-9b34-96b976c287fa-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:07:55 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6d553d45-6233-4f3a-81e6-88fb9501f58c tempest-CinderUnicodeTest-1235186117 None] Lock "cinder-6ecdeaa3-70fc-4bc4-9b34-96b976c287fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:07:55 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6d553d45-6233-4f3a-81e6-88fb9501f58c tempest-CinderUnicodeTest-1235186117 None] Acquiring lock "cinder-quobyte-59bb5fda-6d8b-4a94-b14f-07b593402901" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:07:55 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6d553d45-6233-4f3a-81e6-88fb9501f58c tempest-CinderUnicodeTest-1235186117 None] Lock "cinder-quobyte-59bb5fda-6d8b-4a94-b14f-07b593402901" acquired by "delete_snapshot" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:07:55 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6d553d45-6233-4f3a-81e6-88fb9501f58c tempest-CinderUnicodeTest-1235186117 None] Acquiring lock "cinder-quobyte-6ecdeaa3-70fc-4bc4-9b34-96b976c287fa" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:07:55 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6d553d45-6233-4f3a-81e6-88fb9501f58c tempest-CinderUnicodeTest-1235186117 None] Lock "cinder-quobyte-6ecdeaa3-70fc-4bc4-9b34-96b976c287fa" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:07:55 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-6d553d45-6233-4f3a-81e6-88fb9501f58c tempest-CinderUnicodeTest-1235186117 None] Deleting offline snapshot 6ecdeaa3-70fc-4bc4-9b34-96b976c287fa of volume 59bb5fda-6d8b-4a94-b14f-07b593402901 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 13:07:55 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-6d553d45-6233-4f3a-81e6-88fb9501f58c tempest-CinderUnicodeTest-1235186117 None] snapshot_file for this snap is: volume-59bb5fda-6d8b-4a94-b14f-07b593402901.6ecdeaa3-70fc-4bc4-9b34-96b976c287fa {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 13:07:55 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c88f88-cf77-40f1-a446-be6cd90dc7d9]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:07:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6d553d45-6233-4f3a-81e6-88fb9501f58c tempest-CinderUnicodeTest-1235186117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901.6ecdeaa3-70fc-4bc4-9b34-96b976c287fa {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:56 devstack sudo[97083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901.6ecdeaa3-70fc-4bc4-9b34-96b976c287fa
Nov 19 13:07:56 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:56 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6d553d45-6233-4f3a-81e6-88fb9501f58c tempest-CinderUnicodeTest-1235186117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901.6ecdeaa3-70fc-4bc4-9b34-96b976c287fa" returned: 0 in 0.573s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-6d553d45-6233-4f3a-81e6-88fb9501f58c tempest-CinderUnicodeTest-1235186117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59bb5fda-6d8b-4a94-b14f-07b593402901(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:07:56 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c836a0-b822-4430-9c74-0a9fc0158194]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:07:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6d553d45-6233-4f3a-81e6-88fb9501f58c tempest-CinderUnicodeTest-1235186117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:56 devstack sudo[97088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901
Nov 19 13:07:56 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:57 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6d553d45-6233-4f3a-81e6-88fb9501f58c tempest-CinderUnicodeTest-1235186117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901" returned: 0 in 0.589s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6d553d45-6233-4f3a-81e6-88fb9501f58c tempest-CinderUnicodeTest-1235186117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901.6ecdeaa3-70fc-4bc4-9b34-96b976c287fa {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:57 devstack sudo[97096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901.6ecdeaa3-70fc-4bc4-9b34-96b976c287fa
Nov 19 13:07:57 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:57 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6d553d45-6233-4f3a-81e6-88fb9501f58c tempest-CinderUnicodeTest-1235186117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901.6ecdeaa3-70fc-4bc4-9b34-96b976c287fa" returned: 0 in 0.487s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6d553d45-6233-4f3a-81e6-88fb9501f58c tempest-CinderUnicodeTest-1235186117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901.6ecdeaa3-70fc-4bc4-9b34-96b976c287fa {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:57 devstack sudo[97101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901.6ecdeaa3-70fc-4bc4-9b34-96b976c287fa
Nov 19 13:07:57 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:58 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6d553d45-6233-4f3a-81e6-88fb9501f58c tempest-CinderUnicodeTest-1235186117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901.6ecdeaa3-70fc-4bc4-9b34-96b976c287fa" returned: 0 in 0.442s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:58 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6d553d45-6233-4f3a-81e6-88fb9501f58c tempest-CinderUnicodeTest-1235186117 None] Lock "cinder-quobyte-6ecdeaa3-70fc-4bc4-9b34-96b976c287fa" released by "_delete_snapshot" :: held 2.162s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:07:58 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6d553d45-6233-4f3a-81e6-88fb9501f58c tempest-CinderUnicodeTest-1235186117 None] Lock "cinder-quobyte-59bb5fda-6d8b-4a94-b14f-07b593402901" released by "delete_snapshot" :: held 2.201s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:07:58 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-6d553d45-6233-4f3a-81e6-88fb9501f58c tempest-CinderUnicodeTest-1235186117 None] Created reservations ['04494ea1-aee5-4189-8195-85c7d2d888cb', '6a67b628-aefe-4285-ae86-281d88a1e4fd', 'ad85553b-4386-429a-ad35-28f42b83f1c8', 'dcd446b1-29f7-4b2d-b6da-7e589b42b4ca'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:07:58 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-6d553d45-6233-4f3a-81e6-88fb9501f58c tempest-CinderUnicodeTest-1235186117 None] Delete snapshot completed successfully.
Nov 19 13:07:58 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6d553d45-6233-4f3a-81e6-88fb9501f58c tempest-CinderUnicodeTest-1235186117 None] Lock "cinder-6ecdeaa3-70fc-4bc4-9b34-96b976c287fa-delete_snapshot" released by "delete_snapshot" :: held 2.312s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:07:59 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-37fbca85-7c80-4bc1-b3f5-c80b2ea4208a tempest-CinderUnicodeTest-1235186117 None] Acquiring lock "cinder-59bb5fda-6d8b-4a94-b14f-07b593402901-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:07:59 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-37fbca85-7c80-4bc1-b3f5-c80b2ea4208a tempest-CinderUnicodeTest-1235186117 None] Lock "cinder-59bb5fda-6d8b-4a94-b14f-07b593402901-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:07:59 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-37fbca85-7c80-4bc1-b3f5-c80b2ea4208a tempest-CinderUnicodeTest-1235186117 None] Acquiring lock "cinder-quobyte-59bb5fda-6d8b-4a94-b14f-07b593402901" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:07:59 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-37fbca85-7c80-4bc1-b3f5-c80b2ea4208a tempest-CinderUnicodeTest-1235186117 None] Lock "cinder-quobyte-59bb5fda-6d8b-4a94-b14f-07b593402901" acquired by "delete_volume" :: waited 0.019s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:07:59 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[701e788f-5495-40c0-8cb9-3c5cb2dbd15b]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:07:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-37fbca85-7c80-4bc1-b3f5-c80b2ea4208a tempest-CinderUnicodeTest-1235186117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:07:59 devstack sudo[97163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901
Nov 19 13:07:59 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:07:59 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root
Nov 19 13:07:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-37fbca85-7c80-4bc1-b3f5-c80b2ea4208a tempest-CinderUnicodeTest-1235186117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901" returned: 0 in 0.667s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:07:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-37fbca85-7c80-4bc1-b3f5-c80b2ea4208a tempest-CinderUnicodeTest-1235186117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:08:00 devstack sudo[97168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901
Nov 19 13:08:00 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:08:00 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root
Nov 19 13:08:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-37fbca85-7c80-4bc1-b3f5-c80b2ea4208a tempest-CinderUnicodeTest-1235186117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-59bb5fda-6d8b-4a94-b14f-07b593402901" returned: 0 in 0.486s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:08:00 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-37fbca85-7c80-4bc1-b3f5-c80b2ea4208a tempest-CinderUnicodeTest-1235186117 None] Lock "cinder-quobyte-59bb5fda-6d8b-4a94-b14f-07b593402901" released by "delete_volume" :: held 1.261s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:08:00 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-37fbca85-7c80-4bc1-b3f5-c80b2ea4208a tempest-CinderUnicodeTest-1235186117 None] Created reservations ['16f0f691-28c4-42cb-95ae-0620f895a811', 'e008b886-68f7-4cc8-bb11-347b40c0ffc5', 'fe98fad9-cd9a-4726-a130-dfa32dcfde46', '491e88c0-fb5f-44f4-a52a-7a3e71738caf'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:08:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-37fbca85-7c80-4bc1-b3f5-c80b2ea4208a tempest-CinderUnicodeTest-1235186117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:08:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-37fbca85-7c80-4bc1-b3f5-c80b2ea4208a tempest-CinderUnicodeTest-1235186117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:08:00 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-37fbca85-7c80-4bc1-b3f5-c80b2ea4208a tempest-CinderUnicodeTest-1235186117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:08:00 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-37fbca85-7c80-4bc1-b3f5-c80b2ea4208a tempest-CinderUnicodeTest-1235186117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:08:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-37fbca85-7c80-4bc1-b3f5-c80b2ea4208a tempest-CinderUnicodeTest-1235186117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:08:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-37fbca85-7c80-4bc1-b3f5-c80b2ea4208a tempest-CinderUnicodeTest-1235186117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:08:00 devstack sudo[97171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:08:00 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:08:01 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root
Nov 19 13:08:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-37fbca85-7c80-4bc1-b3f5-c80b2ea4208a tempest-CinderUnicodeTest-1235186117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.545s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:08:01 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-37fbca85-7c80-4bc1-b3f5-c80b2ea4208a tempest-CinderUnicodeTest-1235186117 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:08:01 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-37fbca85-7c80-4bc1-b3f5-c80b2ea4208a tempest-CinderUnicodeTest-1235186117 None] Deleted volume successfully.
Nov 19 13:08:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-37fbca85-7c80-4bc1-b3f5-c80b2ea4208a tempest-CinderUnicodeTest-1235186117 None] Lock "cinder-59bb5fda-6d8b-4a94-b14f-07b593402901-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:08:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5e6b1841-760a-4a6b-9b3d-0ee0316e1f67 tempest-CinderUnicodeTest-1235186117 None] Acquiring lock "cinder-88cdb30a-c19a-48de-9b28-5f077cf21d7b-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:08:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5e6b1841-760a-4a6b-9b3d-0ee0316e1f67 tempest-CinderUnicodeTest-1235186117 None] Lock "cinder-88cdb30a-c19a-48de-9b28-5f077cf21d7b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:08:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5e6b1841-760a-4a6b-9b3d-0ee0316e1f67 tempest-CinderUnicodeTest-1235186117 None] Acquiring lock "cinder-quobyte-88cdb30a-c19a-48de-9b28-5f077cf21d7b" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:08:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5e6b1841-760a-4a6b-9b3d-0ee0316e1f67 tempest-CinderUnicodeTest-1235186117 None] Lock "cinder-quobyte-88cdb30a-c19a-48de-9b28-5f077cf21d7b" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:08:01 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[76096099-4b1b-408a-8e82-0fa9e370f41d]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:08:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5e6b1841-760a-4a6b-9b3d-0ee0316e1f67 tempest-CinderUnicodeTest-1235186117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-88cdb30a-c19a-48de-9b28-5f077cf21d7b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:08:01 devstack sudo[97174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-88cdb30a-c19a-48de-9b28-5f077cf21d7b
Nov 19 13:08:01 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:08:02 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root
Nov 19 13:08:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5e6b1841-760a-4a6b-9b3d-0ee0316e1f67 tempest-CinderUnicodeTest-1235186117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-88cdb30a-c19a-48de-9b28-5f077cf21d7b" returned: 0 in 0.620s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:08:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5e6b1841-760a-4a6b-9b3d-0ee0316e1f67 tempest-CinderUnicodeTest-1235186117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-88cdb30a-c19a-48de-9b28-5f077cf21d7b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:08:02 devstack sudo[97195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-88cdb30a-c19a-48de-9b28-5f077cf21d7b
Nov 19 13:08:02 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:08:02 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root
Nov 19 13:08:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5e6b1841-760a-4a6b-9b3d-0ee0316e1f67 tempest-CinderUnicodeTest-1235186117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-88cdb30a-c19a-48de-9b28-5f077cf21d7b" returned: 0 in 0.598s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:08:02 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5e6b1841-760a-4a6b-9b3d-0ee0316e1f67 tempest-CinderUnicodeTest-1235186117 None] Lock "cinder-quobyte-88cdb30a-c19a-48de-9b28-5f077cf21d7b" released by "delete_volume" :: held 1.290s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:08:02 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-5e6b1841-760a-4a6b-9b3d-0ee0316e1f67 tempest-CinderUnicodeTest-1235186117 None] Created reservations ['012caca9-cfa6-4220-a354-d13e1ee8b213', '2ab4c2fd-8b32-49a5-b037-5ce0b918cd2e', '030ba010-5565-474f-9ab4-e9edfce81d53', '753ee4d3-cc64-48e3-94e2-ce5c269379be'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:08:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5e6b1841-760a-4a6b-9b3d-0ee0316e1f67 tempest-CinderUnicodeTest-1235186117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:08:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5e6b1841-760a-4a6b-9b3d-0ee0316e1f67 tempest-CinderUnicodeTest-1235186117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:08:02 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5e6b1841-760a-4a6b-9b3d-0ee0316e1f67 tempest-CinderUnicodeTest-1235186117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:08:02 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5e6b1841-760a-4a6b-9b3d-0ee0316e1f67 tempest-CinderUnicodeTest-1235186117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:08:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5e6b1841-760a-4a6b-9b3d-0ee0316e1f67 tempest-CinderUnicodeTest-1235186117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:08:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5e6b1841-760a-4a6b-9b3d-0ee0316e1f67 tempest-CinderUnicodeTest-1235186117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:08:02 devstack sudo[97218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:08:02 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:08:03 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root
Nov 19 13:08:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5e6b1841-760a-4a6b-9b3d-0ee0316e1f67 tempest-CinderUnicodeTest-1235186117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.451s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:08:03 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-5e6b1841-760a-4a6b-9b3d-0ee0316e1f67 tempest-CinderUnicodeTest-1235186117 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:08:03 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-5e6b1841-760a-4a6b-9b3d-0ee0316e1f67 tempest-CinderUnicodeTest-1235186117 None] Deleted volume successfully.
Nov 19 13:08:03 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5e6b1841-760a-4a6b-9b3d-0ee0316e1f67 tempest-CinderUnicodeTest-1235186117 None] Lock "cinder-88cdb30a-c19a-48de-9b28-5f077cf21d7b-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:08:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 13:08:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:08:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:08:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:08:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:08:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:08:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:08:04 devstack sudo[97222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:08:04 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:08:04 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root
Nov 19 13:08:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.499s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:08:05 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:08:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b35e7594-8891-449e-b509-e73624e65086 tempest-VolumesNegativeTest-392285953 None] Acquiring lock "cinder-f822bfcc-8789-44bb-8c22-c22f2f90ec06-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:08:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b35e7594-8891-449e-b509-e73624e65086 tempest-VolumesNegativeTest-392285953 None] Lock "cinder-f822bfcc-8789-44bb-8c22-c22f2f90ec06-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:08:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b35e7594-8891-449e-b509-e73624e65086 tempest-VolumesNegativeTest-392285953 None] Acquiring lock "cinder-quobyte-f822bfcc-8789-44bb-8c22-c22f2f90ec06" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:08:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b35e7594-8891-449e-b509-e73624e65086 tempest-VolumesNegativeTest-392285953 None] Lock "cinder-quobyte-f822bfcc-8789-44bb-8c22-c22f2f90ec06" acquired by "delete_volume" :: waited 0.012s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:08:10 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c769b8f-efed-484c-9ca6-2a528e1c4220]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:08:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b35e7594-8891-449e-b509-e73624e65086 tempest-VolumesNegativeTest-392285953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-f822bfcc-8789-44bb-8c22-c22f2f90ec06 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:08:10 devstack sudo[97236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-f822bfcc-8789-44bb-8c22-c22f2f90ec06
Nov 19 13:08:10 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:08:11 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root
Nov 19 13:08:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b35e7594-8891-449e-b509-e73624e65086 tempest-VolumesNegativeTest-392285953 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-f822bfcc-8789-44bb-8c22-c22f2f90ec06" returned: 0 in 0.536s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:08:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b35e7594-8891-449e-b509-e73624e65086 tempest-VolumesNegativeTest-392285953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-f822bfcc-8789-44bb-8c22-c22f2f90ec06 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:08:11 devstack sudo[97241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-f822bfcc-8789-44bb-8c22-c22f2f90ec06
Nov 19 13:08:11 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:08:11 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root
Nov 19 13:08:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b35e7594-8891-449e-b509-e73624e65086 tempest-VolumesNegativeTest-392285953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-f822bfcc-8789-44bb-8c22-c22f2f90ec06" returned: 0 in 0.445s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:08:11 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b35e7594-8891-449e-b509-e73624e65086 tempest-VolumesNegativeTest-392285953 None] Lock "cinder-quobyte-f822bfcc-8789-44bb-8c22-c22f2f90ec06" released by "delete_volume" :: held 1.015s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:08:11 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-b35e7594-8891-449e-b509-e73624e65086 tempest-VolumesNegativeTest-392285953 None] Created reservations ['963ef35a-99ac-469e-9b4e-d748b17a9836', '99a65130-5699-498b-ae32-2e85b943dd08', 'b32aadcc-6675-43cb-bcd4-6908e597e53d', '887e6b50-bdaa-417f-86e7-98075613b4f2'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:08:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b35e7594-8891-449e-b509-e73624e65086 tempest-VolumesNegativeTest-392285953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:08:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b35e7594-8891-449e-b509-e73624e65086 tempest-VolumesNegativeTest-392285953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:08:11 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b35e7594-8891-449e-b509-e73624e65086 tempest-VolumesNegativeTest-392285953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:08:11 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b35e7594-8891-449e-b509-e73624e65086 tempest-VolumesNegativeTest-392285953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:08:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b35e7594-8891-449e-b509-e73624e65086 tempest-VolumesNegativeTest-392285953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:08:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b35e7594-8891-449e-b509-e73624e65086 tempest-VolumesNegativeTest-392285953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:08:11 devstack sudo[97244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:08:11 devstack sudo[97244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:08:12 devstack sudo[97244]: pam_unix(sudo:session): session closed for user root
Nov 19 13:08:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b35e7594-8891-449e-b509-e73624e65086 tempest-VolumesNegativeTest-392285953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.424s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:08:12 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-b35e7594-8891-449e-b509-e73624e65086 tempest-VolumesNegativeTest-392285953 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:08:12 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-b35e7594-8891-449e-b509-e73624e65086 tempest-VolumesNegativeTest-392285953 None] Deleted volume successfully.
Nov 19 13:08:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b35e7594-8891-449e-b509-e73624e65086 tempest-VolumesNegativeTest-392285953 None] Lock "cinder-f822bfcc-8789-44bb-8c22-c22f2f90ec06-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:08:21 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=87,cinder:INSERT=25,cinder:UPDATE=104,cinder:DELETE=10 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:08:22 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=77,cinder:UPDATE=119,cinder:INSERT=36,cinder:DELETE=9 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Flow 'volume_create_manager' (6938762c-3271-4dac-b2d6-85cbac803edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db99a5ef-91c0-43c2-85cd-2cc2dfa34eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db99a5ef-91c0-43c2-85cd-2cc2dfa34eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-842872137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5420158-2d82-4b51-b96b-33884d722fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='991028850bdf44b39be5829f2ec9c213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:08:27Z,use_quota=True,user_id='5ccf373f73154e7caac0facf0eaef912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e287a14a-0769-48c3-a94a-56ba09a43231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e287a14a-0769-48c3-a94a-56ba09a43231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c1550d-cd3e-4aa2-ae94-bca993cb34c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c1550d-cd3e-4aa2-ae94-bca993cb34c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5420158-2d82-4b51-b96b-33884d722fb1', 'volume_name': 'volume-d5420158-2d82-4b51-b96b-33884d722fb1', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847382f8-c07e-4020-a7a6-24e9c74fa9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847382f8-c07e-4020-a7a6-24e9c74fa9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8809b2d5-184c-42e7-bbef-5424a7c48782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:08:27 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Volume d5420158-2d82-4b51-b96b-33884d722fb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5420158-2d82-4b51-b96b-33884d722fb1', 'volume_size': 1}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-842872137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5420158-2d82-4b51-b96b-33884d722fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='991028850bdf44b39be5829f2ec9c213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:08:27Z,use_quota=True,user_id='5ccf373f73154e7caac0facf0eaef912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Creating volume d5420158-2d82-4b51-b96b-33884d722fb1 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:08:27 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5420158-2d82-4b51-b96b-33884d722fb1 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:08:27 devstack sudo[97249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5420158-2d82-4b51-b96b-33884d722fb1 1073741824
Nov 19 13:08:27 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Flow 'volume_create_manager' (f762927e-abc6-4617-aa35-0fb8e6795a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe802dc-7b94-4426-abbd-151065f109f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe802dc-7b94-4426-abbd-151065f109f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-126192540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fcb21c3-0e17-4572-bce1-c999c51774da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='991028850bdf44b39be5829f2ec9c213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:08:27Z,use_quota=True,user_id='5ccf373f73154e7caac0facf0eaef912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (666c9984-783b-4e3d-aba8-85a36033d293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (666c9984-783b-4e3d-aba8-85a36033d293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a3bd7fc-d36a-4668-b081-7e80a31fdfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a3bd7fc-d36a-4668-b081-7e80a31fdfc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fcb21c3-0e17-4572-bce1-c999c51774da', 'volume_name': 'volume-5fcb21c3-0e17-4572-bce1-c999c51774da', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72a4780-5256-46cc-a5c9-52fe68390c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72a4780-5256-46cc-a5c9-52fe68390c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa49f72-fd09-4fdd-bb5f-7725eb5c05d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:08:27 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Volume 5fcb21c3-0e17-4572-bce1-c999c51774da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fcb21c3-0e17-4572-bce1-c999c51774da', 'volume_size': 1}
Nov 19 13:08:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:08:28 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root
Nov 19 13:08:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5420158-2d82-4b51-b96b-33884d722fb1 1073741824" returned: 0 in 0.709s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:08:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5420158-2d82-4b51-b96b-33884d722fb1 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:08:28 devstack sudo[97258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5420158-2d82-4b51-b96b-33884d722fb1
Nov 19 13:08:28 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:08:28 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root
Nov 19 13:08:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5420158-2d82-4b51-b96b-33884d722fb1" returned: 0 in 0.529s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:08:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:08:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:08:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.057s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:08:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-126192540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fcb21c3-0e17-4572-bce1-c999c51774da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='991028850bdf44b39be5829f2ec9c213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:08:27Z,use_quota=True,user_id='5ccf373f73154e7caac0facf0eaef912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:08:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Creating volume 5fcb21c3-0e17-4572-bce1-c999c51774da {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:08:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:08:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:08:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:08:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:08:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:08:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:08:28 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:08:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5fcb21c3-0e17-4572-bce1-c999c51774da 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:08:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8809b2d5-184c-42e7-bbef-5424a7c48782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5420158-2d82-4b51-b96b-33884d722fb1', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:08:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87f8aa69-0b35-43ff-b7a7-ecdd4f09bdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:08:28 devstack sudo[97263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5fcb21c3-0e17-4572-bce1-c999c51774da 1073741824
Nov 19 13:08:28 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:08:28 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Volume volume-d5420158-2d82-4b51-b96b-33884d722fb1 (d5420158-2d82-4b51-b96b-33884d722fb1): created successfully
Nov 19 13:08:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87f8aa69-0b35-43ff-b7a7-ecdd4f09bdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:08:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Flow 'volume_create_manager' (6938762c-3271-4dac-b2d6-85cbac803edd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:08:28 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-e09b8127-1a4c-4123-8bc1-50dafc6225d5 tempest-TestServerVolumeAttachmentScenario-387679109 None] Created volume successfully.
Nov 19 13:08:29 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root
Nov 19 13:08:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5fcb21c3-0e17-4572-bce1-c999c51774da 1073741824" returned: 0 in 0.609s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:08:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5fcb21c3-0e17-4572-bce1-c999c51774da {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:08:29 devstack sudo[97271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5fcb21c3-0e17-4572-bce1-c999c51774da
Nov 19 13:08:29 devstack sudo[97271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:08:29 devstack sudo[97271]: pam_unix(sudo:session): session closed for user root
Nov 19 13:08:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5fcb21c3-0e17-4572-bce1-c999c51774da" returned: 0 in 0.525s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:08:29 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:08:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:08:29 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa49f72-fd09-4fdd-bb5f-7725eb5c05d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fcb21c3-0e17-4572-bce1-c999c51774da', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:08:29 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8cc986-4436-4be0-a097-5b2325c1a9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:08:29 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Volume volume-5fcb21c3-0e17-4572-bce1-c999c51774da (5fcb21c3-0e17-4572-bce1-c999c51774da): created successfully
Nov 19 13:08:29 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8cc986-4436-4be0-a097-5b2325c1a9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:08:29 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Flow 'volume_create_manager' (f762927e-abc6-4617-aa35-0fb8e6795a77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:08:29 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-3c837e2a-6c45-4ff8-b0d2-06ce7e515cfe tempest-TestServerVolumeAttachmentScenario-387679109 None] Created volume successfully.
Nov 19 13:08:39 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=3,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:08:39 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:08:53 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:08:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Flow 'volume_create_manager' (eaf6e5eb-895c-425a-822c-93d662b2ea69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:08:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5251991a-c832-4cb0-92ae-a98d7be54ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:08:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5251991a-c832-4cb0-92ae-a98d7be54ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-800331739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba049027-3b4c-4a76-bd70-7461b1910d36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='362a76d25f3b445c90521e1ca2654b62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:08:54Z,use_quota=True,user_id='f7b17c4bba214fcb89c5f78a45d50024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:08:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c16e66a1-9d8f-43cc-9d37-99ca0bc95856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:08:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c16e66a1-9d8f-43cc-9d37-99ca0bc95856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:08:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e650c1e1-d863-4b31-9dae-c4dd3eb994e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:08:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e650c1e1-d863-4b31-9dae-c4dd3eb994e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba049027-3b4c-4a76-bd70-7461b1910d36', 'volume_name': 'volume-ba049027-3b4c-4a76-bd70-7461b1910d36', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:08:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b35d39e9-94ba-4e27-bf90-e1e46391f069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:08:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b35d39e9-94ba-4e27-bf90-e1e46391f069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:08:53 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7afedfed-d126-4bc0-ae75-7ae2a942b9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:08:53 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Volume ba049027-3b4c-4a76-bd70-7461b1910d36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba049027-3b4c-4a76-bd70-7461b1910d36', 'volume_size': 1}
Nov 19 13:08:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:08:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:08:53 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-800331739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba049027-3b4c-4a76-bd70-7461b1910d36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='362a76d25f3b445c90521e1ca2654b62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:08:54Z,use_quota=True,user_id='f7b17c4bba214fcb89c5f78a45d50024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:08:53 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Creating volume ba049027-3b4c-4a76-bd70-7461b1910d36 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:08:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:08:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:08:53 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:08:53 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:08:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:08:53 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:08:53 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:08:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ba049027-3b4c-4a76-bd70-7461b1910d36 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:08:53 devstack sudo[97434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ba049027-3b4c-4a76-bd70-7461b1910d36 1073741824
Nov 19 13:08:53 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:08:54 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root
Nov 19 13:08:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ba049027-3b4c-4a76-bd70-7461b1910d36 1073741824" returned: 0 in 0.564s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:08:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ba049027-3b4c-4a76-bd70-7461b1910d36 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:08:54 devstack sudo[97439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ba049027-3b4c-4a76-bd70-7461b1910d36
Nov 19 13:08:54 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:08:54 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root
Nov 19 13:08:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ba049027-3b4c-4a76-bd70-7461b1910d36" returned: 0 in 0.437s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:08:54 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:08:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:08:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7afedfed-d126-4bc0-ae75-7ae2a942b9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba049027-3b4c-4a76-bd70-7461b1910d36', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:08:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3210e7b3-00c3-4ba2-a612-6f4790a48164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:08:54 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Volume volume-ba049027-3b4c-4a76-bd70-7461b1910d36 (ba049027-3b4c-4a76-bd70-7461b1910d36): created successfully
Nov 19 13:08:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3210e7b3-00c3-4ba2-a612-6f4790a48164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:08:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Flow 'volume_create_manager' (eaf6e5eb-895c-425a-822c-93d662b2ea69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:08:54 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-1825152a-05c6-4c28-bf42-a1a0c305d060 tempest-AttachVolumeNegativeTest-324058728 None] Created volume successfully.
Nov 19 13:08:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-6240fcec-8b2c-42d2-937a-7b82303fdb82 req-7352e4a1-506f-4d45-837e-cd8c2c8a2b04 tempest-AttachVolumeNegativeTest-324058728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:08:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-6240fcec-8b2c-42d2-937a-7b82303fdb82 req-7352e4a1-506f-4d45-837e-cd8c2c8a2b04 tempest-AttachVolumeNegativeTest-324058728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:08:58 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[600636bf-a8f1-4093-94c7-721b0d77a124]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:08:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-6240fcec-8b2c-42d2-937a-7b82303fdb82 req-7352e4a1-506f-4d45-837e-cd8c2c8a2b04 tempest-AttachVolumeNegativeTest-324058728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ba049027-3b4c-4a76-bd70-7461b1910d36 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:08:58 devstack sudo[97452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ba049027-3b4c-4a76-bd70-7461b1910d36
Nov 19 13:08:58 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:08:59 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root
Nov 19 13:08:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-6240fcec-8b2c-42d2-937a-7b82303fdb82 req-7352e4a1-506f-4d45-837e-cd8c2c8a2b04 tempest-AttachVolumeNegativeTest-324058728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ba049027-3b4c-4a76-bd70-7461b1910d36" returned: 0 in 0.563s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:08:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-6240fcec-8b2c-42d2-937a-7b82303fdb82 req-7352e4a1-506f-4d45-837e-cd8c2c8a2b04 tempest-AttachVolumeNegativeTest-324058728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.573s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:08:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-6240fcec-8b2c-42d2-937a-7b82303fdb82 req-7352e4a1-506f-4d45-837e-cd8c2c8a2b04 tempest-AttachVolumeNegativeTest-324058728 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-ba049027-3b4c-4a76-bd70-7461b1910d36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'df9c8afd-a4c3-407d-b8fc-3bce607892a3', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 13:08:59 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-6240fcec-8b2c-42d2-937a-7b82303fdb82 req-7352e4a1-506f-4d45-837e-cd8c2c8a2b04 tempest-AttachVolumeNegativeTest-324058728 None] attachment_update completed successfully.
Nov 19 13:09:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 13:09:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:09:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:09:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:09:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:09:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:09:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:09:04 devstack sudo[97872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:09:04 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:09:04 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root
Nov 19 13:09:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.500s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:09:05 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:09:09 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:09:09 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:UPDATE=6,cinder:DELETE=1,cinder:SELECT=5 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:09:30 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=1 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:09:30 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:UPDATE=1 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:09:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-9e0b27de-1039-42b7-b812-1ef7d34c7e28 req-7c38d1d4-71ee-44f9-b044-a11b351d06b0 tempest-TestServerVolumeAttachmentScenario-387679109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:09:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-9e0b27de-1039-42b7-b812-1ef7d34c7e28 req-7c38d1d4-71ee-44f9-b044-a11b351d06b0 tempest-TestServerVolumeAttachmentScenario-387679109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:09:49 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d28d5e-d4de-4432-b088-4413b83d20ca]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:09:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-9e0b27de-1039-42b7-b812-1ef7d34c7e28 req-7c38d1d4-71ee-44f9-b044-a11b351d06b0 tempest-TestServerVolumeAttachmentScenario-387679109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5420158-2d82-4b51-b96b-33884d722fb1 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:09:49 devstack sudo[98074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5420158-2d82-4b51-b96b-33884d722fb1
Nov 19 13:09:49 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:09:49 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root
Nov 19 13:09:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-9e0b27de-1039-42b7-b812-1ef7d34c7e28 req-7c38d1d4-71ee-44f9-b044-a11b351d06b0 tempest-TestServerVolumeAttachmentScenario-387679109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5420158-2d82-4b51-b96b-33884d722fb1" returned: 0 in 0.530s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:09:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-9e0b27de-1039-42b7-b812-1ef7d34c7e28 req-7c38d1d4-71ee-44f9-b044-a11b351d06b0 tempest-TestServerVolumeAttachmentScenario-387679109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.546s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:09:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-9e0b27de-1039-42b7-b812-1ef7d34c7e28 req-7c38d1d4-71ee-44f9-b044-a11b351d06b0 tempest-TestServerVolumeAttachmentScenario-387679109 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-d5420158-2d82-4b51-b96b-33884d722fb1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a10b82c0-5881-4445-900a-ea8a3e39f864', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 13:09:49 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-9e0b27de-1039-42b7-b812-1ef7d34c7e28 req-7c38d1d4-71ee-44f9-b044-a11b351d06b0 tempest-TestServerVolumeAttachmentScenario-387679109 None] attachment_update completed successfully.
Nov 19 13:09:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-306fe6ca-9c92-4317-8001-b69f56b0bf46 req-2738fbd3-a821-43a9-8b58-0281aefdfef6 tempest-TestServerVolumeAttachmentScenario-387679109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:09:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-306fe6ca-9c92-4317-8001-b69f56b0bf46 req-2738fbd3-a821-43a9-8b58-0281aefdfef6 tempest-TestServerVolumeAttachmentScenario-387679109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:09:58 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d7a713-caf1-412f-a998-22e9e1232d40]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:09:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-306fe6ca-9c92-4317-8001-b69f56b0bf46 req-2738fbd3-a821-43a9-8b58-0281aefdfef6 tempest-TestServerVolumeAttachmentScenario-387679109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5fcb21c3-0e17-4572-bce1-c999c51774da {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:09:58 devstack sudo[98109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5fcb21c3-0e17-4572-bce1-c999c51774da
Nov 19 13:09:58 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:09:58 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root
Nov 19 13:09:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-306fe6ca-9c92-4317-8001-b69f56b0bf46 req-2738fbd3-a821-43a9-8b58-0281aefdfef6 tempest-TestServerVolumeAttachmentScenario-387679109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5fcb21c3-0e17-4572-bce1-c999c51774da" returned: 0 in 0.554s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:09:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-306fe6ca-9c92-4317-8001-b69f56b0bf46 req-2738fbd3-a821-43a9-8b58-0281aefdfef6 tempest-TestServerVolumeAttachmentScenario-387679109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.564s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:09:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-306fe6ca-9c92-4317-8001-b69f56b0bf46 req-2738fbd3-a821-43a9-8b58-0281aefdfef6 tempest-TestServerVolumeAttachmentScenario-387679109 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-5fcb21c3-0e17-4572-bce1-c999c51774da', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '424e54d3-97ba-4672-b921-89a591a9da60', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 13:09:58 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-306fe6ca-9c92-4317-8001-b69f56b0bf46 req-2738fbd3-a821-43a9-8b58-0281aefdfef6 tempest-TestServerVolumeAttachmentScenario-387679109 None] attachment_update completed successfully.
Nov 19 13:10:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 13:10:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:10:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:10:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:10:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:10:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:10:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:10:04 devstack sudo[98121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:10:04 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:10:04 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root
Nov 19 13:10:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.423s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:10:04 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:10:05 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-317cf114-92fe-455a-97fb-93aedb591d5c req-6f51ee7f-4923-44bb-8a30-cd14aa977793 tempest-TestServerVolumeAttachmentScenario-387679109 None] Terminate volume connection completed successfully.
Nov 19 13:10:05 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-317cf114-92fe-455a-97fb-93aedb591d5c req-6f51ee7f-4923-44bb-8a30-cd14aa977793 tempest-TestServerVolumeAttachmentScenario-387679109 None] Deleting attachment 424e54d3-97ba-4672-b921-89a591a9da60. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 13:10:08 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-a9831448-b4aa-49da-a99d-f8facaecc1da req-483a28d9-add2-4f55-b52b-894a0a2bc6e1 tempest-TestServerVolumeAttachmentScenario-387679109 None] Terminate volume connection completed successfully.
Nov 19 13:10:08 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-a9831448-b4aa-49da-a99d-f8facaecc1da req-483a28d9-add2-4f55-b52b-894a0a2bc6e1 tempest-TestServerVolumeAttachmentScenario-387679109 None] Deleting attachment a10b82c0-5881-4445-900a-ea8a3e39f864. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 13:10:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-bb4bdf51-6ea9-494c-8158-3790949a1bec tempest-TestServerVolumeAttachmentScenario-387679109 None] Acquiring lock "cinder-5fcb21c3-0e17-4572-bce1-c999c51774da-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:10:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-bb4bdf51-6ea9-494c-8158-3790949a1bec tempest-TestServerVolumeAttachmentScenario-387679109 None] Lock "cinder-5fcb21c3-0e17-4572-bce1-c999c51774da-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:10:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-bb4bdf51-6ea9-494c-8158-3790949a1bec tempest-TestServerVolumeAttachmentScenario-387679109 None] Acquiring lock "cinder-quobyte-5fcb21c3-0e17-4572-bce1-c999c51774da" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:10:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-bb4bdf51-6ea9-494c-8158-3790949a1bec tempest-TestServerVolumeAttachmentScenario-387679109 None] Lock "cinder-quobyte-5fcb21c3-0e17-4572-bce1-c999c51774da" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:10:18 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[79064daa-da53-46c8-b303-9366d39a121f]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:10:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-bb4bdf51-6ea9-494c-8158-3790949a1bec tempest-TestServerVolumeAttachmentScenario-387679109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5fcb21c3-0e17-4572-bce1-c999c51774da {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:10:18 devstack sudo[98174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5fcb21c3-0e17-4572-bce1-c999c51774da
Nov 19 13:10:18 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:10:19 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root
Nov 19 13:10:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-bb4bdf51-6ea9-494c-8158-3790949a1bec tempest-TestServerVolumeAttachmentScenario-387679109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5fcb21c3-0e17-4572-bce1-c999c51774da" returned: 0 in 0.535s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:10:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-bb4bdf51-6ea9-494c-8158-3790949a1bec tempest-TestServerVolumeAttachmentScenario-387679109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5fcb21c3-0e17-4572-bce1-c999c51774da {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:10:19 devstack sudo[98179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5fcb21c3-0e17-4572-bce1-c999c51774da
Nov 19 13:10:19 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:10:19 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root
Nov 19 13:10:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-bb4bdf51-6ea9-494c-8158-3790949a1bec tempest-TestServerVolumeAttachmentScenario-387679109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5fcb21c3-0e17-4572-bce1-c999c51774da" returned: 0 in 0.424s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:10:19 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-bb4bdf51-6ea9-494c-8158-3790949a1bec tempest-TestServerVolumeAttachmentScenario-387679109 None] Lock "cinder-quobyte-5fcb21c3-0e17-4572-bce1-c999c51774da" released by "delete_volume" :: held 0.980s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:10:19 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-bb4bdf51-6ea9-494c-8158-3790949a1bec tempest-TestServerVolumeAttachmentScenario-387679109 None] Created reservations ['6939af6c-fbbf-4970-91ae-fc4c68bf7665', '5e70befa-da8c-4c8b-a9e7-f52f2db43580', '90002425-8b03-4e56-9eeb-98bfcaf87dcd', '312362ed-d476-4b32-a09d-b330bc2cc07a'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:10:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-bb4bdf51-6ea9-494c-8158-3790949a1bec tempest-TestServerVolumeAttachmentScenario-387679109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:10:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-bb4bdf51-6ea9-494c-8158-3790949a1bec tempest-TestServerVolumeAttachmentScenario-387679109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:10:19 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-bb4bdf51-6ea9-494c-8158-3790949a1bec tempest-TestServerVolumeAttachmentScenario-387679109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:10:19 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-bb4bdf51-6ea9-494c-8158-3790949a1bec tempest-TestServerVolumeAttachmentScenario-387679109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:10:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-bb4bdf51-6ea9-494c-8158-3790949a1bec tempest-TestServerVolumeAttachmentScenario-387679109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:10:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-bb4bdf51-6ea9-494c-8158-3790949a1bec tempest-TestServerVolumeAttachmentScenario-387679109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:10:19 devstack sudo[98182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:10:19 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:10:20 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root
Nov 19 13:10:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-bb4bdf51-6ea9-494c-8158-3790949a1bec tempest-TestServerVolumeAttachmentScenario-387679109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.412s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:10:20 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-bb4bdf51-6ea9-494c-8158-3790949a1bec tempest-TestServerVolumeAttachmentScenario-387679109 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:10:20 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-bb4bdf51-6ea9-494c-8158-3790949a1bec tempest-TestServerVolumeAttachmentScenario-387679109 None] Deleted volume successfully.
Nov 19 13:10:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-bb4bdf51-6ea9-494c-8158-3790949a1bec tempest-TestServerVolumeAttachmentScenario-387679109 None] Lock "cinder-5fcb21c3-0e17-4572-bce1-c999c51774da-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:10:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c90b6007-64bb-46ee-aff0-5e39cc08e0af tempest-TestServerVolumeAttachmentScenario-387679109 None] Acquiring lock "cinder-d5420158-2d82-4b51-b96b-33884d722fb1-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:10:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c90b6007-64bb-46ee-aff0-5e39cc08e0af tempest-TestServerVolumeAttachmentScenario-387679109 None] Lock "cinder-d5420158-2d82-4b51-b96b-33884d722fb1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:10:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c90b6007-64bb-46ee-aff0-5e39cc08e0af tempest-TestServerVolumeAttachmentScenario-387679109 None] Acquiring lock "cinder-quobyte-d5420158-2d82-4b51-b96b-33884d722fb1" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:10:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c90b6007-64bb-46ee-aff0-5e39cc08e0af tempest-TestServerVolumeAttachmentScenario-387679109 None] Lock "cinder-quobyte-d5420158-2d82-4b51-b96b-33884d722fb1" acquired by "delete_volume" :: waited 0.006s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:10:20 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1093a784-c873-48cb-8eb4-a895a470d304]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:10:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c90b6007-64bb-46ee-aff0-5e39cc08e0af tempest-TestServerVolumeAttachmentScenario-387679109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5420158-2d82-4b51-b96b-33884d722fb1 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:10:20 devstack sudo[98185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5420158-2d82-4b51-b96b-33884d722fb1
Nov 19 13:10:20 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:10:21 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root
Nov 19 13:10:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c90b6007-64bb-46ee-aff0-5e39cc08e0af tempest-TestServerVolumeAttachmentScenario-387679109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5420158-2d82-4b51-b96b-33884d722fb1" returned: 0 in 0.521s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:10:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c90b6007-64bb-46ee-aff0-5e39cc08e0af tempest-TestServerVolumeAttachmentScenario-387679109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5420158-2d82-4b51-b96b-33884d722fb1 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:10:21 devstack sudo[98190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5420158-2d82-4b51-b96b-33884d722fb1
Nov 19 13:10:21 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:10:21 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root
Nov 19 13:10:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c90b6007-64bb-46ee-aff0-5e39cc08e0af tempest-TestServerVolumeAttachmentScenario-387679109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5420158-2d82-4b51-b96b-33884d722fb1" returned: 0 in 0.422s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:10:21 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c90b6007-64bb-46ee-aff0-5e39cc08e0af tempest-TestServerVolumeAttachmentScenario-387679109 None] Lock "cinder-quobyte-d5420158-2d82-4b51-b96b-33884d722fb1" released by "delete_volume" :: held 0.969s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:10:21 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-c90b6007-64bb-46ee-aff0-5e39cc08e0af tempest-TestServerVolumeAttachmentScenario-387679109 None] Created reservations ['f2f3a457-c698-4a28-a013-2630faf6d5ab', '3efce4a9-70bf-4074-be1a-95192b070220', '7eb7c16b-cadd-4342-b513-4a88d1ba454a', '4be55e1d-462d-4f37-876c-78d65e674a5e'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:10:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c90b6007-64bb-46ee-aff0-5e39cc08e0af tempest-TestServerVolumeAttachmentScenario-387679109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:10:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c90b6007-64bb-46ee-aff0-5e39cc08e0af tempest-TestServerVolumeAttachmentScenario-387679109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:10:21 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c90b6007-64bb-46ee-aff0-5e39cc08e0af tempest-TestServerVolumeAttachmentScenario-387679109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:10:21 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c90b6007-64bb-46ee-aff0-5e39cc08e0af tempest-TestServerVolumeAttachmentScenario-387679109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:10:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c90b6007-64bb-46ee-aff0-5e39cc08e0af tempest-TestServerVolumeAttachmentScenario-387679109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:10:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c90b6007-64bb-46ee-aff0-5e39cc08e0af tempest-TestServerVolumeAttachmentScenario-387679109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:10:21 devstack sudo[98195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:10:21 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:10:22 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root
Nov 19 13:10:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c90b6007-64bb-46ee-aff0-5e39cc08e0af tempest-TestServerVolumeAttachmentScenario-387679109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.446s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:10:22 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-c90b6007-64bb-46ee-aff0-5e39cc08e0af tempest-TestServerVolumeAttachmentScenario-387679109 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:10:22 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-c90b6007-64bb-46ee-aff0-5e39cc08e0af tempest-TestServerVolumeAttachmentScenario-387679109 None] Deleted volume successfully.
Nov 19 13:10:22 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c90b6007-64bb-46ee-aff0-5e39cc08e0af tempest-TestServerVolumeAttachmentScenario-387679109 None] Lock "cinder-d5420158-2d82-4b51-b96b-33884d722fb1-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:10:31 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-5123708a-1248-4928-9843-61ddbf0912ee req-9dcef315-9e8c-4435-97c0-05daadd1f0a0 tempest-AttachVolumeNegativeTest-324058728 None] Terminate volume connection completed successfully.
Nov 19 13:10:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-5123708a-1248-4928-9843-61ddbf0912ee req-9dcef315-9e8c-4435-97c0-05daadd1f0a0 tempest-AttachVolumeNegativeTest-324058728 None] Deleting attachment df9c8afd-a4c3-407d-b8fc-3bce607892a3. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 13:10:41 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=25,cinder:UPDATE=19,cinder:INSERT=5,cinder:DELETE=2 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:10:41 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=23,cinder:UPDATE=19,cinder:INSERT=3 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:10:45 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:10:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Flow 'volume_create_manager' (35bda332-7684-46a6-bbc8-e1bc9e763df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:10:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (978681cb-2a68-4ab0-b791-02ed28032f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:10:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (978681cb-2a68-4ab0-b791-02ed28032f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-955853164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11b4e6a-dfde-432b-8026-5c3bd9d99226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d353b936984d4c1f9a886bfa59923f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:10:46Z,use_quota=True,user_id='c94b2b780146440dbf2a7b80d8fc4b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:10:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d8d25c7-0f54-4a30-be17-5851812b9363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:10:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d8d25c7-0f54-4a30-be17-5851812b9363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:10:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df6b56a-6f67-4db1-8356-d2c2cbddbb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:10:45 devstack cinder-volume[80839]: DEBUG cinder.image.glance [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Creating Keystone auth plugin from conf {{(pid=80839) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Nov 19 13:10:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df6b56a-6f67-4db1-8356-d2c2cbddbb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c11b4e6a-dfde-432b-8026-5c3bd9d99226', 'volume_name': 'volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226', 'volume_size': 1, 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb13a00dd9444268988d63a8279e0575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5d491c17-c417-4a2b-886e-ad2958917626', 'created_at': datetime.datetime(2025, 11, 19, 11, 46, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 19, 11, 46, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d491c17-c417-4a2b-886e-ad2958917626/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbd13e02260>}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:10:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ec4a31-6c4a-4649-804f-7cf66925ab64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:10:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ec4a31-6c4a-4649-804f-7cf66925ab64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:10:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c2cfbf9-b0a6-47a3-80d5-f2f82b75df6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:10:45 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Volume c11b4e6a-dfde-432b-8026-5c3bd9d99226: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226', 'volume_size': 1, 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb13a00dd9444268988d63a8279e0575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5d491c17-c417-4a2b-886e-ad2958917626', 'created_at': datetime.datetime(2025, 11, 19, 11, 46, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 19, 11, 46, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d491c17-c417-4a2b-886e-ad2958917626/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbd13e02260>}
Nov 19 13:10:45 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Cloning c11b4e6a-dfde-432b-8026-5c3bd9d99226 from image 5d491c17-c417-4a2b-886e-ad2958917626  at location (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]). {{(pid=80839) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Nov 19 13:10:46 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_tw9ze2s6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=80839) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Nov 19 13:10:46 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Image download 20.69 MB at 20.69 MB/s
Nov 19 13:10:46 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[91294829-c1c6-4529-8435-7ec577a83edf]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:10:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_tw9ze2s6devstack@QuobyteHD {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:10:46 devstack sudo[98330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_tw9ze2s6devstack@QuobyteHD
Nov 19 13:10:46 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:10:46 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root
Nov 19 13:10:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_tw9ze2s6devstack@QuobyteHD" returned: 0 in 0.539s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:10:46 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Temporary image 5d491c17-c417-4a2b-886e-ad2958917626 is fetched for user c94b2b780146440dbf2a7b80d8fc4b75. {{(pid=80839) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Nov 19 13:10:46 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d792a060-2fc4-4d87-9771-0381e482ca2e]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:10:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_tw9ze2s6devstack@QuobyteHD {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:10:46 devstack sudo[98335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_tw9ze2s6devstack@QuobyteHD
Nov 19 13:10:46 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:10:47 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root
Nov 19 13:10:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_tw9ze2s6devstack@QuobyteHD" returned: 0 in 0.530s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:10:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:10:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:10:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-955853164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11b4e6a-dfde-432b-8026-5c3bd9d99226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d353b936984d4c1f9a886bfa59923f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:10:46Z,use_quota=True,user_id='c94b2b780146440dbf2a7b80d8fc4b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:10:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Creating volume c11b4e6a-dfde-432b-8026-5c3bd9d99226 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:10:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:10:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:10:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:10:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:10:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:10:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:10:47 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:10:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:10:47 devstack sudo[98340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226 1073741824
Nov 19 13:10:47 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:10:47 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root
Nov 19 13:10:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226 1073741824" returned: 0 in 0.624s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:10:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:10:47 devstack sudo[98345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226
Nov 19 13:10:47 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:10:48 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root
Nov 19 13:10:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226" returned: 0 in 0.466s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:10:48 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:10:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:10:48 devstack cinder-volume[80839]: DEBUG cinder.volume.volume_utils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Attempting download of 5d491c17-c417-4a2b-886e-ad2958917626 ((None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}])) to volume c11b4e6a-dfde-432b-8026-5c3bd9d99226. {{(pid=80839) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Nov 19 13:10:48 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fe8d7a-4a93-462c-8b44-0bfac00beecd]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:10:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_lzg8b4jh {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:10:48 devstack sudo[98348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_lzg8b4jh
Nov 19 13:10:48 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:10:49 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root
Nov 19 13:10:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_lzg8b4jh" returned: 0 in 0.689s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:10:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_lzg8b4jh {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:10:49 devstack sudo[98352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_lzg8b4jh
Nov 19 13:10:49 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:10:49 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root
Nov 19 13:10:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_lzg8b4jh" returned: 1 in 0.576s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:10:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d491c17-c417-4a2b-886e-ad2958917626_lzg8b4jh' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 13:10:49 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c8889a-0d58-41b6-9ef0-3099d4209351]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:10:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_tw9ze2s6devstack@QuobyteHD {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:10:49 devstack sudo[98359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_tw9ze2s6devstack@QuobyteHD
Nov 19 13:10:49 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:10:50 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root
Nov 19 13:10:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_tw9ze2s6devstack@QuobyteHD" returned: 0 in 0.543s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:10:50 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] 5d491c17-c417-4a2b-886e-ad2958917626 was qcow2, converting to raw {{(pid=80839) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Nov 19 13:10:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_tw9ze2s6devstack@QuobyteHD /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:10:50 devstack sudo[98377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_tw9ze2s6devstack@QuobyteHD /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226
Nov 19 13:10:50 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:10:51 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root
Nov 19 13:10:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_tw9ze2s6devstack@QuobyteHD /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226" returned: 0 in 0.825s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:10:51 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5d491c17-c417-4a2b-886e-ad2958917626_tw9ze2s6devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226 {{(pid=80839) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 19 13:10:51 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Converted 112.00 MB image at 112.00 MB/s
Nov 19 13:10:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:10:51 devstack sudo[98395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226 1G
Nov 19 13:10:51 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:10:51 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root
Nov 19 13:10:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226 1G" returned: 0 in 0.465s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:10:51 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e212cc5-7e23-4c8d-9864-d62851da9f17]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:10:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:10:51 devstack sudo[98400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226
Nov 19 13:10:51 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:10:52 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root
Nov 19 13:10:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226" returned: 0 in 0.525s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:10:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:10:52 devstack sudo[98404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226
Nov 19 13:10:52 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:10:52 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root
Nov 19 13:10:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226" returned: 1 in 0.555s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:10:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 13:10:52 devstack cinder-volume[80839]: DEBUG cinder.volume.volume_utils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Downloaded image 5d491c17-c417-4a2b-886e-ad2958917626 ((None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}])) to volume c11b4e6a-dfde-432b-8026-5c3bd9d99226 successfully. {{(pid=80839) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Nov 19 13:10:52 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Temporary image 5d491c17-c417-4a2b-886e-ad2958917626 for user c94b2b780146440dbf2a7b80d8fc4b75 is deleted. {{(pid=80839) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Nov 19 13:10:52 devstack cinder-volume[80839]: DEBUG cinder.volume.volume_utils [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Marking volume c11b4e6a-dfde-432b-8026-5c3bd9d99226 as bootable. {{(pid=80839) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Nov 19 13:10:52 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Copying metadata from image 5d491c17-c417-4a2b-886e-ad2958917626 to c11b4e6a-dfde-432b-8026-5c3bd9d99226. {{(pid=80839) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 19 13:10:52 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Creating volume glance metadata for volume c11b4e6a-dfde-432b-8026-5c3bd9d99226 backed by image 5d491c17-c417-4a2b-886e-ad2958917626 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=80839) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 19 13:10:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c2cfbf9-b0a6-47a3-80d5-f2f82b75df6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226', 'volume_size': 1, 'image_id': '5d491c17-c417-4a2b-886e-ad2958917626', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d491c17-c417-4a2b-886e-ad2958917626', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb13a00dd9444268988d63a8279e0575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5d491c17-c417-4a2b-886e-ad2958917626', 'created_at': datetime.datetime(2025, 11, 19, 11, 46, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 11, 19, 11, 46, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d491c17-c417-4a2b-886e-ad2958917626/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fbd13e02260>}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:10:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1226604-8f58-4f24-9408-766b8e4630eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:10:52 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Volume volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226 (c11b4e6a-dfde-432b-8026-5c3bd9d99226): created successfully
Nov 19 13:10:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1226604-8f58-4f24-9408-766b8e4630eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:10:52 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Flow 'volume_create_manager' (35bda332-7684-46a6-bbc8-e1bc9e763df7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:10:52 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-a1aad175-bd15-45c7-a38b-ba5cf44d7667 tempest-TestShelveInstance-472740391 None] Created volume successfully.
Nov 19 13:10:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-094f787b-8abe-4c33-a7a7-9f2cac55221d req-aaf15f43-e2c9-4152-96ea-d26757bab4f2 tempest-TestShelveInstance-472740391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:10:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-094f787b-8abe-4c33-a7a7-9f2cac55221d req-aaf15f43-e2c9-4152-96ea-d26757bab4f2 tempest-TestShelveInstance-472740391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:10:59 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[de28dd6c-ce74-46e2-b035-a36681f9e59d]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:10:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-094f787b-8abe-4c33-a7a7-9f2cac55221d req-aaf15f43-e2c9-4152-96ea-d26757bab4f2 tempest-TestShelveInstance-472740391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:10:59 devstack sudo[98487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226
Nov 19 13:10:59 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:11:00 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root
Nov 19 13:11:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-094f787b-8abe-4c33-a7a7-9f2cac55221d req-aaf15f43-e2c9-4152-96ea-d26757bab4f2 tempest-TestShelveInstance-472740391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226" returned: 0 in 0.643s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:11:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-094f787b-8abe-4c33-a7a7-9f2cac55221d req-aaf15f43-e2c9-4152-96ea-d26757bab4f2 tempest-TestShelveInstance-472740391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:11:00 devstack sudo[98491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226
Nov 19 13:11:00 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:11:01 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root
Nov 19 13:11:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-094f787b-8abe-4c33-a7a7-9f2cac55221d req-aaf15f43-e2c9-4152-96ea-d26757bab4f2 tempest-TestShelveInstance-472740391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226" returned: 1 in 0.529s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:11:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-094f787b-8abe-4c33-a7a7-9f2cac55221d req-aaf15f43-e2c9-4152-96ea-d26757bab4f2 tempest-TestShelveInstance-472740391 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 13:11:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-094f787b-8abe-4c33-a7a7-9f2cac55221d req-aaf15f43-e2c9-4152-96ea-d26757bab4f2 tempest-TestShelveInstance-472740391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.198s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:11:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-094f787b-8abe-4c33-a7a7-9f2cac55221d req-aaf15f43-e2c9-4152-96ea-d26757bab4f2 tempest-TestShelveInstance-472740391 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a12e7daf-bb7b-4a29-ac9f-433d5a980c30', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 13:11:01 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-094f787b-8abe-4c33-a7a7-9f2cac55221d req-aaf15f43-e2c9-4152-96ea-d26757bab4f2 tempest-TestShelveInstance-472740391 None] attachment_update completed successfully.
Nov 19 13:11:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 13:11:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:11:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:11:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:11:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:11:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:11:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:11:04 devstack sudo[98567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:11:04 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:11:04 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root
Nov 19 13:11:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.493s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:11:04 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:11:11 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=12,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:11:11 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=16,cinder:UPDATE=7,cinder:INSERT=12,cinder:DELETE=1 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:11:30 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:12:00 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:12:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Flow 'volume_create_manager' (0e043245-3b4f-4614-bd58-fa042c101b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:12:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83bf9cd5-439e-401d-b0d7-25ae353ab814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:12:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83bf9cd5-439e-401d-b0d7-25ae353ab814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-323619238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=963f31b4-6566-40f9-9062-6a557de472e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='362a76d25f3b445c90521e1ca2654b62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:12:00Z,use_quota=True,user_id='f7b17c4bba214fcb89c5f78a45d50024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:12:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f87e66-d4a4-42f8-ba7a-1b0a70b261f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:12:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f87e66-d4a4-42f8-ba7a-1b0a70b261f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:12:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (646c9b76-1f1d-4de4-a927-1ee0f20e1dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:12:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (646c9b76-1f1d-4de4-a927-1ee0f20e1dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '963f31b4-6566-40f9-9062-6a557de472e6', 'volume_name': 'volume-963f31b4-6566-40f9-9062-6a557de472e6', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:12:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31e921d9-e083-4c5b-95f1-e9443a6ff7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:12:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31e921d9-e083-4c5b-95f1-e9443a6ff7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:12:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40796c03-1a99-49c4-9530-7daa0950d022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:12:00 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Volume 963f31b4-6566-40f9-9062-6a557de472e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-963f31b4-6566-40f9-9062-6a557de472e6', 'volume_size': 1}
Nov 19 13:12:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:12:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:12:00 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-323619238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=963f31b4-6566-40f9-9062-6a557de472e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='362a76d25f3b445c90521e1ca2654b62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:12:00Z,use_quota=True,user_id='f7b17c4bba214fcb89c5f78a45d50024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:12:00 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Creating volume 963f31b4-6566-40f9-9062-6a557de472e6 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:12:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:12:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:12:00 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:12:00 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:12:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:12:00 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:12:00 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:12:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-963f31b4-6566-40f9-9062-6a557de472e6 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:12:00 devstack sudo[99090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-963f31b4-6566-40f9-9062-6a557de472e6 1073741824
Nov 19 13:12:00 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:12:00 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root
Nov 19 13:12:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-963f31b4-6566-40f9-9062-6a557de472e6 1073741824" returned: 0 in 0.534s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:12:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-963f31b4-6566-40f9-9062-6a557de472e6 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:12:00 devstack sudo[99095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-963f31b4-6566-40f9-9062-6a557de472e6
Nov 19 13:12:00 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:12:01 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root
Nov 19 13:12:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-963f31b4-6566-40f9-9062-6a557de472e6" returned: 0 in 0.435s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:12:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:12:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:12:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40796c03-1a99-49c4-9530-7daa0950d022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-963f31b4-6566-40f9-9062-6a557de472e6', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:12:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d416228-71a4-4168-8b35-d80c91e02b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:12:01 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Volume volume-963f31b4-6566-40f9-9062-6a557de472e6 (963f31b4-6566-40f9-9062-6a557de472e6): created successfully
Nov 19 13:12:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d416228-71a4-4168-8b35-d80c91e02b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:12:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Flow 'volume_create_manager' (0e043245-3b4f-4614-bd58-fa042c101b3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:12:01 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-496ef036-6fb2-4e41-a2ce-8f8a8984a581 tempest-AttachVolumeNegativeTest-324058728 None] Created volume successfully.
Nov 19 13:12:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 13:12:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:12:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:12:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:12:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:12:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:12:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:12:04 devstack sudo[99099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:12:04 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:12:04 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root
Nov 19 13:12:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.450s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:12:04 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:12:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-38bb2f76-6069-4b8e-85ac-c0b9c74d116a req-7c511b70-bcd0-46ef-862d-6c2e4c27c69d tempest-AttachVolumeNegativeTest-324058728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:12:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-38bb2f76-6069-4b8e-85ac-c0b9c74d116a req-7c511b70-bcd0-46ef-862d-6c2e4c27c69d tempest-AttachVolumeNegativeTest-324058728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:12:05 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[28593abb-b51f-4253-8ae3-69e5b2617714]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:12:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-38bb2f76-6069-4b8e-85ac-c0b9c74d116a req-7c511b70-bcd0-46ef-862d-6c2e4c27c69d tempest-AttachVolumeNegativeTest-324058728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-963f31b4-6566-40f9-9062-6a557de472e6 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:12:05 devstack sudo[99115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-963f31b4-6566-40f9-9062-6a557de472e6
Nov 19 13:12:05 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:12:05 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root
Nov 19 13:12:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-38bb2f76-6069-4b8e-85ac-c0b9c74d116a req-7c511b70-bcd0-46ef-862d-6c2e4c27c69d tempest-AttachVolumeNegativeTest-324058728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-963f31b4-6566-40f9-9062-6a557de472e6" returned: 0 in 0.561s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:12:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-38bb2f76-6069-4b8e-85ac-c0b9c74d116a req-7c511b70-bcd0-46ef-862d-6c2e4c27c69d tempest-AttachVolumeNegativeTest-324058728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.570s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:12:05 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-38bb2f76-6069-4b8e-85ac-c0b9c74d116a req-7c511b70-bcd0-46ef-862d-6c2e4c27c69d tempest-AttachVolumeNegativeTest-324058728 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-963f31b4-6566-40f9-9062-6a557de472e6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '34da7fe1-628c-4a0a-a42f-177045f80c44', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 13:12:05 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-38bb2f76-6069-4b8e-85ac-c0b9c74d116a req-7c511b70-bcd0-46ef-862d-6c2e4c27c69d tempest-AttachVolumeNegativeTest-324058728 None] attachment_update completed successfully.
Nov 19 13:12:11 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-98379448-f93d-41ea-a0a8-16dd954e65f1 req-81344be9-eeff-479d-b020-d099caec75b2 tempest-AttachVolumeNegativeTest-324058728 None] Terminate volume connection completed successfully.
Nov 19 13:12:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-98379448-f93d-41ea-a0a8-16dd954e65f1 req-81344be9-eeff-479d-b020-d099caec75b2 tempest-AttachVolumeNegativeTest-324058728 None] Deleting attachment 34da7fe1-628c-4a0a-a42f-177045f80c44. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 13:12:19 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-d4771f47-c560-4d45-a3ed-660e3a0793d1 req-b0437fdf-54c7-4c00-bb19-177526bef568 tempest-TestShelveInstance-472740391 None] Terminate volume connection completed successfully.
Nov 19 13:12:19 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-d4771f47-c560-4d45-a3ed-660e3a0793d1 req-b0437fdf-54c7-4c00-bb19-177526bef568 tempest-TestShelveInstance-472740391 None] Deleting attachment a12e7daf-bb7b-4a29-ac9f-433d5a980c30. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 13:12:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-ec4ba1e6-b56a-4915-ab7c-7d7996de67db req-4f8afe3a-fda9-47e1-9bd1-2fa277dc0301 tempest-TestShelveInstance-472740391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:12:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-ec4ba1e6-b56a-4915-ab7c-7d7996de67db req-4f8afe3a-fda9-47e1-9bd1-2fa277dc0301 tempest-TestShelveInstance-472740391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:12:24 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35078f2-e476-474b-857a-b25a1e60bab1]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:12:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-ec4ba1e6-b56a-4915-ab7c-7d7996de67db req-4f8afe3a-fda9-47e1-9bd1-2fa277dc0301 tempest-TestShelveInstance-472740391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:12:24 devstack sudo[99219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226
Nov 19 13:12:24 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:12:24 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root
Nov 19 13:12:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-ec4ba1e6-b56a-4915-ab7c-7d7996de67db req-4f8afe3a-fda9-47e1-9bd1-2fa277dc0301 tempest-TestShelveInstance-472740391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226" returned: 0 in 0.536s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:12:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-ec4ba1e6-b56a-4915-ab7c-7d7996de67db req-4f8afe3a-fda9-47e1-9bd1-2fa277dc0301 tempest-TestShelveInstance-472740391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:12:24 devstack sudo[99223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226
Nov 19 13:12:24 devstack sudo[99223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:12:25 devstack sudo[99223]: pam_unix(sudo:session): session closed for user root
Nov 19 13:12:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-ec4ba1e6-b56a-4915-ab7c-7d7996de67db req-4f8afe3a-fda9-47e1-9bd1-2fa277dc0301 tempest-TestShelveInstance-472740391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226" returned: 1 in 0.530s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:12:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-ec4ba1e6-b56a-4915-ab7c-7d7996de67db req-4f8afe3a-fda9-47e1-9bd1-2fa277dc0301 tempest-TestShelveInstance-472740391 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 13:12:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-ec4ba1e6-b56a-4915-ab7c-7d7996de67db req-4f8afe3a-fda9-47e1-9bd1-2fa277dc0301 tempest-TestShelveInstance-472740391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.093s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:12:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-ec4ba1e6-b56a-4915-ab7c-7d7996de67db req-4f8afe3a-fda9-47e1-9bd1-2fa277dc0301 tempest-TestShelveInstance-472740391 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f08400bc-8aa6-4bc8-9bc0-f883bf3509c0', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 13:12:25 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-ec4ba1e6-b56a-4915-ab7c-7d7996de67db req-4f8afe3a-fda9-47e1-9bd1-2fa277dc0301 tempest-TestShelveInstance-472740391 None] attachment_update completed successfully.
Nov 19 13:12:35 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:12:35 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:UPDATE=6,cinder:SELECT=16,cinder:DELETE=1 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:13:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 13:13:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:13:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:13:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:13:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:13:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:13:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:13:04 devstack sudo[99841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:13:04 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:13:04 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root
Nov 19 13:13:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.417s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:13:04 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:13:30 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:13:39 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:13:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Flow 'volume_create_manager' (267607b5-b527-4383-a262-ab32807991b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:13:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3001003a-ad90-4bec-84ab-f55d320da546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:13:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3001003a-ad90-4bec-84ab-f55d320da546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-542829853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfda97cd-092f-4cc7-b574-8e43162b77c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='362a76d25f3b445c90521e1ca2654b62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:13:40Z,use_quota=True,user_id='f7b17c4bba214fcb89c5f78a45d50024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:13:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b0f667f-df29-44c3-8f37-8c6129953312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:13:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b0f667f-df29-44c3-8f37-8c6129953312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:13:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe45efe1-5a9a-4e25-a04b-5c19947829b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:13:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe45efe1-5a9a-4e25-a04b-5c19947829b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfda97cd-092f-4cc7-b574-8e43162b77c0', 'volume_name': 'volume-dfda97cd-092f-4cc7-b574-8e43162b77c0', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:13:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b696ddd2-b8f9-4edd-a1b0-d0228a872a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:13:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b696ddd2-b8f9-4edd-a1b0-d0228a872a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:13:39 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7434641f-410f-4f43-9376-905033770853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:13:39 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Volume dfda97cd-092f-4cc7-b574-8e43162b77c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfda97cd-092f-4cc7-b574-8e43162b77c0', 'volume_size': 1}
Nov 19 13:13:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:13:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:13:39 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-542829853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfda97cd-092f-4cc7-b574-8e43162b77c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='362a76d25f3b445c90521e1ca2654b62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:13:40Z,use_quota=True,user_id='f7b17c4bba214fcb89c5f78a45d50024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:13:39 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Creating volume dfda97cd-092f-4cc7-b574-8e43162b77c0 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:13:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:13:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:13:39 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:13:39 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:13:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:13:39 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:13:39 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:13:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfda97cd-092f-4cc7-b574-8e43162b77c0 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:13:39 devstack sudo[99937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfda97cd-092f-4cc7-b574-8e43162b77c0 1073741824
Nov 19 13:13:39 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:13:40 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root
Nov 19 13:13:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfda97cd-092f-4cc7-b574-8e43162b77c0 1073741824" returned: 0 in 0.551s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:13:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfda97cd-092f-4cc7-b574-8e43162b77c0 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:13:40 devstack sudo[99944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfda97cd-092f-4cc7-b574-8e43162b77c0
Nov 19 13:13:40 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:13:40 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root
Nov 19 13:13:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfda97cd-092f-4cc7-b574-8e43162b77c0" returned: 0 in 0.458s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:13:40 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:13:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:13:40 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7434641f-410f-4f43-9376-905033770853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfda97cd-092f-4cc7-b574-8e43162b77c0', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:13:40 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21de1180-73df-4e4b-9b9b-a8198b962bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:13:40 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Volume volume-dfda97cd-092f-4cc7-b574-8e43162b77c0 (dfda97cd-092f-4cc7-b574-8e43162b77c0): created successfully
Nov 19 13:13:40 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21de1180-73df-4e4b-9b9b-a8198b962bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:13:40 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Flow 'volume_create_manager' (267607b5-b527-4383-a262-ab32807991b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:13:40 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-77f035fc-e316-4de3-bfe0-4a289df1af6d tempest-AttachVolumeNegativeTest-324058728 None] Created volume successfully.
Nov 19 13:13:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-06eaa07d-04f5-4e31-904f-66b2ef3abf2f req-938fbae9-d145-4872-aa21-9c35be93c308 tempest-AttachVolumeNegativeTest-324058728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:13:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-06eaa07d-04f5-4e31-904f-66b2ef3abf2f req-938fbae9-d145-4872-aa21-9c35be93c308 tempest-AttachVolumeNegativeTest-324058728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:13:44 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4457c7e-9697-4eae-9e22-04c0a0619710]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:13:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-06eaa07d-04f5-4e31-904f-66b2ef3abf2f req-938fbae9-d145-4872-aa21-9c35be93c308 tempest-AttachVolumeNegativeTest-324058728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfda97cd-092f-4cc7-b574-8e43162b77c0 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:13:44 devstack sudo[99997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfda97cd-092f-4cc7-b574-8e43162b77c0
Nov 19 13:13:44 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:13:45 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root
Nov 19 13:13:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-06eaa07d-04f5-4e31-904f-66b2ef3abf2f req-938fbae9-d145-4872-aa21-9c35be93c308 tempest-AttachVolumeNegativeTest-324058728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfda97cd-092f-4cc7-b574-8e43162b77c0" returned: 0 in 0.563s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:13:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-06eaa07d-04f5-4e31-904f-66b2ef3abf2f req-938fbae9-d145-4872-aa21-9c35be93c308 tempest-AttachVolumeNegativeTest-324058728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.572s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:13:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-06eaa07d-04f5-4e31-904f-66b2ef3abf2f req-938fbae9-d145-4872-aa21-9c35be93c308 tempest-AttachVolumeNegativeTest-324058728 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0', 'name': 'volume-dfda97cd-092f-4cc7-b574-8e43162b77c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3137eb2a-13bc-4ac0-9ea2-31cfd32bda93', 'enforce_multipath': True} {{(pid=80839) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4892}}
Nov 19 13:13:45 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-9dea8d3e-540c-4926-ae8d-32153eeb891c req-f500194e-110e-42b6-83a2-f8a2ccf6d2b1 tempest-TestShelveInstance-472740391 None] Terminate volume connection completed successfully.
Nov 19 13:13:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-9dea8d3e-540c-4926-ae8d-32153eeb891c req-f500194e-110e-42b6-83a2-f8a2ccf6d2b1 tempest-TestShelveInstance-472740391 None] Deleting attachment f08400bc-8aa6-4bc8-9bc0-f883bf3509c0. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 13:13:45 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-06eaa07d-04f5-4e31-904f-66b2ef3abf2f req-938fbae9-d145-4872-aa21-9c35be93c308 tempest-AttachVolumeNegativeTest-324058728 None] attachment_update completed successfully.
Nov 19 13:13:45 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-9dea8d3e-540c-4926-ae8d-32153eeb891c req-07bff7a7-0a47-4059-b4c7-9681e3b2c4a0 tempest-TestShelveInstance-472740391 None] Acquiring lock "cinder-c11b4e6a-dfde-432b-8026-5c3bd9d99226-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:13:46 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-9dea8d3e-540c-4926-ae8d-32153eeb891c req-07bff7a7-0a47-4059-b4c7-9681e3b2c4a0 tempest-TestShelveInstance-472740391 None] Lock "cinder-c11b4e6a-dfde-432b-8026-5c3bd9d99226-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:13:46 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-9dea8d3e-540c-4926-ae8d-32153eeb891c req-07bff7a7-0a47-4059-b4c7-9681e3b2c4a0 tempest-TestShelveInstance-472740391 None] Acquiring lock "cinder-quobyte-c11b4e6a-dfde-432b-8026-5c3bd9d99226" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:13:46 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-9dea8d3e-540c-4926-ae8d-32153eeb891c req-07bff7a7-0a47-4059-b4c7-9681e3b2c4a0 tempest-TestShelveInstance-472740391 None] Lock "cinder-quobyte-c11b4e6a-dfde-432b-8026-5c3bd9d99226" acquired by "delete_volume" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:13:46 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ae417a-47f2-475f-9d76-2284e96a8f15]: (4, 'raw') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:13:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-9dea8d3e-540c-4926-ae8d-32153eeb891c req-07bff7a7-0a47-4059-b4c7-9681e3b2c4a0 tempest-TestShelveInstance-472740391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:13:46 devstack sudo[100068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226
Nov 19 13:13:46 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:13:46 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root
Nov 19 13:13:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-9dea8d3e-540c-4926-ae8d-32153eeb891c req-07bff7a7-0a47-4059-b4c7-9681e3b2c4a0 tempest-TestShelveInstance-472740391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226" returned: 0 in 0.553s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:13:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-9dea8d3e-540c-4926-ae8d-32153eeb891c req-07bff7a7-0a47-4059-b4c7-9681e3b2c4a0 tempest-TestShelveInstance-472740391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:13:46 devstack sudo[100389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226
Nov 19 13:13:46 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:13:47 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root
Nov 19 13:13:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-9dea8d3e-540c-4926-ae8d-32153eeb891c req-07bff7a7-0a47-4059-b4c7-9681e3b2c4a0 tempest-TestShelveInstance-472740391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226" returned: 1 in 0.568s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:13:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-9dea8d3e-540c-4926-ae8d-32153eeb891c req-07bff7a7-0a47-4059-b4c7-9681e3b2c4a0 tempest-TestShelveInstance-472740391 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226' failed. Not Retrying. {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Nov 19 13:13:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-9dea8d3e-540c-4926-ae8d-32153eeb891c req-07bff7a7-0a47-4059-b4c7-9681e3b2c4a0 tempest-TestShelveInstance-472740391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:13:47 devstack sudo[100394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226
Nov 19 13:13:47 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:13:47 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root
Nov 19 13:13:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-9dea8d3e-540c-4926-ae8d-32153eeb891c req-07bff7a7-0a47-4059-b4c7-9681e3b2c4a0 tempest-TestShelveInstance-472740391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c11b4e6a-dfde-432b-8026-5c3bd9d99226" returned: 0 in 0.466s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:13:47 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-9dea8d3e-540c-4926-ae8d-32153eeb891c req-07bff7a7-0a47-4059-b4c7-9681e3b2c4a0 tempest-TestShelveInstance-472740391 None] Lock "cinder-quobyte-c11b4e6a-dfde-432b-8026-5c3bd9d99226" released by "delete_volume" :: held 1.627s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:13:47 devstack cinder-volume[80839]: DEBUG cinder.quota [req-9dea8d3e-540c-4926-ae8d-32153eeb891c req-07bff7a7-0a47-4059-b4c7-9681e3b2c4a0 tempest-TestShelveInstance-472740391 None] Created reservations ['b06d7e2f-dc0b-4128-b8a3-f8d9d51a3f83', 'f39bf84a-50e5-44f3-a8d1-e3cc4082d468', 'f9f219e2-ebed-458b-8ef4-42b3478f59a5', 'a6cc1f48-f5a0-4423-a6b4-4418cec3644a'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:13:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-9dea8d3e-540c-4926-ae8d-32153eeb891c req-07bff7a7-0a47-4059-b4c7-9681e3b2c4a0 tempest-TestShelveInstance-472740391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:13:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-9dea8d3e-540c-4926-ae8d-32153eeb891c req-07bff7a7-0a47-4059-b4c7-9681e3b2c4a0 tempest-TestShelveInstance-472740391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:13:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [req-9dea8d3e-540c-4926-ae8d-32153eeb891c req-07bff7a7-0a47-4059-b4c7-9681e3b2c4a0 tempest-TestShelveInstance-472740391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:13:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [req-9dea8d3e-540c-4926-ae8d-32153eeb891c req-07bff7a7-0a47-4059-b4c7-9681e3b2c4a0 tempest-TestShelveInstance-472740391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:13:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [req-9dea8d3e-540c-4926-ae8d-32153eeb891c req-07bff7a7-0a47-4059-b4c7-9681e3b2c4a0 tempest-TestShelveInstance-472740391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:13:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-9dea8d3e-540c-4926-ae8d-32153eeb891c req-07bff7a7-0a47-4059-b4c7-9681e3b2c4a0 tempest-TestShelveInstance-472740391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:13:47 devstack sudo[100397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:13:47 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:13:48 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root
Nov 19 13:13:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [req-9dea8d3e-540c-4926-ae8d-32153eeb891c req-07bff7a7-0a47-4059-b4c7-9681e3b2c4a0 tempest-TestShelveInstance-472740391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.431s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:13:48 devstack cinder-volume[80839]: DEBUG cinder.manager [req-9dea8d3e-540c-4926-ae8d-32153eeb891c req-07bff7a7-0a47-4059-b4c7-9681e3b2c4a0 tempest-TestShelveInstance-472740391 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:13:48 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-9dea8d3e-540c-4926-ae8d-32153eeb891c req-07bff7a7-0a47-4059-b4c7-9681e3b2c4a0 tempest-TestShelveInstance-472740391 None] Deleted volume successfully.
Nov 19 13:13:48 devstack cinder-volume[80839]: DEBUG cinder.coordination [req-9dea8d3e-540c-4926-ae8d-32153eeb891c req-07bff7a7-0a47-4059-b4c7-9681e3b2c4a0 tempest-TestShelveInstance-472740391 None] Lock "cinder-c11b4e6a-dfde-432b-8026-5c3bd9d99226-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:13:51 devstack cinder-volume[80839]: INFO cinder.volume.manager [req-0fe24980-fd8c-4415-b368-73e1232247b1 req-35fc80a8-f4e2-4644-92a8-d0c2c89f1bd6 tempest-AttachVolumeNegativeTest-324058728 None] Terminate volume connection completed successfully.
Nov 19 13:13:51 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [req-0fe24980-fd8c-4415-b368-73e1232247b1 req-35fc80a8-f4e2-4644-92a8-d0c2c89f1bd6 tempest-AttachVolumeNegativeTest-324058728 None] Deleting attachment 3137eb2a-13bc-4ac0-9ea2-31cfd32bda93. {{(pid=80839) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5023}}
Nov 19 13:14:01 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:UPDATE=11,cinder:SELECT=13,cinder:INSERT=3 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:14:01 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=14,cinder:UPDATE=12,cinder:DELETE=2,cinder:INSERT=1 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:14:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 13:14:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:14:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:14:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:14:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:14:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:14:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:04 devstack sudo[100473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:14:04 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:04 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.422s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:04 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:14:05 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-25ac2f7b-f79b-48d3-8237-245598093c74 tempest-AttachVolumeNegativeTest-324058728 None] Acquiring lock "cinder-dfda97cd-092f-4cc7-b574-8e43162b77c0-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:14:05 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-25ac2f7b-f79b-48d3-8237-245598093c74 tempest-AttachVolumeNegativeTest-324058728 None] Lock "cinder-dfda97cd-092f-4cc7-b574-8e43162b77c0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:14:05 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-25ac2f7b-f79b-48d3-8237-245598093c74 tempest-AttachVolumeNegativeTest-324058728 None] Acquiring lock "cinder-quobyte-dfda97cd-092f-4cc7-b574-8e43162b77c0" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:14:05 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-25ac2f7b-f79b-48d3-8237-245598093c74 tempest-AttachVolumeNegativeTest-324058728 None] Lock "cinder-quobyte-dfda97cd-092f-4cc7-b574-8e43162b77c0" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:14:05 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecf288c-5b78-467e-b0c4-acd8d83a3f7f]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:14:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-25ac2f7b-f79b-48d3-8237-245598093c74 tempest-AttachVolumeNegativeTest-324058728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfda97cd-092f-4cc7-b574-8e43162b77c0 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:05 devstack sudo[100476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfda97cd-092f-4cc7-b574-8e43162b77c0
Nov 19 13:14:05 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:06 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-25ac2f7b-f79b-48d3-8237-245598093c74 tempest-AttachVolumeNegativeTest-324058728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfda97cd-092f-4cc7-b574-8e43162b77c0" returned: 0 in 0.688s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-25ac2f7b-f79b-48d3-8237-245598093c74 tempest-AttachVolumeNegativeTest-324058728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfda97cd-092f-4cc7-b574-8e43162b77c0 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:06 devstack sudo[100481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfda97cd-092f-4cc7-b574-8e43162b77c0
Nov 19 13:14:06 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:06 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-25ac2f7b-f79b-48d3-8237-245598093c74 tempest-AttachVolumeNegativeTest-324058728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfda97cd-092f-4cc7-b574-8e43162b77c0" returned: 0 in 0.472s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:06 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-25ac2f7b-f79b-48d3-8237-245598093c74 tempest-AttachVolumeNegativeTest-324058728 None] Lock "cinder-quobyte-dfda97cd-092f-4cc7-b574-8e43162b77c0" released by "delete_volume" :: held 1.184s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:14:06 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-25ac2f7b-f79b-48d3-8237-245598093c74 tempest-AttachVolumeNegativeTest-324058728 None] Created reservations ['60ba2ad8-e4ca-443f-ba60-937b981ca306', '132d4777-2e62-45a4-aa52-ee34158ca7ff', 'bd41e637-1858-4e94-bf2f-82431413a342', 'f9147762-50ff-4325-96e9-3af41cb3d1e8'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:14:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-25ac2f7b-f79b-48d3-8237-245598093c74 tempest-AttachVolumeNegativeTest-324058728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:14:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-25ac2f7b-f79b-48d3-8237-245598093c74 tempest-AttachVolumeNegativeTest-324058728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:14:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-25ac2f7b-f79b-48d3-8237-245598093c74 tempest-AttachVolumeNegativeTest-324058728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:14:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-25ac2f7b-f79b-48d3-8237-245598093c74 tempest-AttachVolumeNegativeTest-324058728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:14:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-25ac2f7b-f79b-48d3-8237-245598093c74 tempest-AttachVolumeNegativeTest-324058728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:14:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-25ac2f7b-f79b-48d3-8237-245598093c74 tempest-AttachVolumeNegativeTest-324058728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:06 devstack sudo[100484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:14:06 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:07 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-25ac2f7b-f79b-48d3-8237-245598093c74 tempest-AttachVolumeNegativeTest-324058728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.541s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:07 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-25ac2f7b-f79b-48d3-8237-245598093c74 tempest-AttachVolumeNegativeTest-324058728 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:14:07 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-25ac2f7b-f79b-48d3-8237-245598093c74 tempest-AttachVolumeNegativeTest-324058728 None] Deleted volume successfully.
Nov 19 13:14:07 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-25ac2f7b-f79b-48d3-8237-245598093c74 tempest-AttachVolumeNegativeTest-324058728 None] Lock "cinder-dfda97cd-092f-4cc7-b574-8e43162b77c0-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:14:07 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-455b6da0-e19d-4eb1-bf3a-b925c7d42d4c tempest-AttachVolumeNegativeTest-324058728 None] Acquiring lock "cinder-963f31b4-6566-40f9-9062-6a557de472e6-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:14:07 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-455b6da0-e19d-4eb1-bf3a-b925c7d42d4c tempest-AttachVolumeNegativeTest-324058728 None] Lock "cinder-963f31b4-6566-40f9-9062-6a557de472e6-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:14:07 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-455b6da0-e19d-4eb1-bf3a-b925c7d42d4c tempest-AttachVolumeNegativeTest-324058728 None] Acquiring lock "cinder-quobyte-963f31b4-6566-40f9-9062-6a557de472e6" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:14:07 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-455b6da0-e19d-4eb1-bf3a-b925c7d42d4c tempest-AttachVolumeNegativeTest-324058728 None] Lock "cinder-quobyte-963f31b4-6566-40f9-9062-6a557de472e6" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:14:07 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e748dee4-0d6a-450f-9bf3-ecfd4ac7996c]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:14:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-455b6da0-e19d-4eb1-bf3a-b925c7d42d4c tempest-AttachVolumeNegativeTest-324058728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-963f31b4-6566-40f9-9062-6a557de472e6 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:07 devstack sudo[100487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-963f31b4-6566-40f9-9062-6a557de472e6
Nov 19 13:14:07 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:08 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-455b6da0-e19d-4eb1-bf3a-b925c7d42d4c tempest-AttachVolumeNegativeTest-324058728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-963f31b4-6566-40f9-9062-6a557de472e6" returned: 0 in 0.606s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-455b6da0-e19d-4eb1-bf3a-b925c7d42d4c tempest-AttachVolumeNegativeTest-324058728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-963f31b4-6566-40f9-9062-6a557de472e6 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:08 devstack sudo[100492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-963f31b4-6566-40f9-9062-6a557de472e6
Nov 19 13:14:08 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:08 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-455b6da0-e19d-4eb1-bf3a-b925c7d42d4c tempest-AttachVolumeNegativeTest-324058728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-963f31b4-6566-40f9-9062-6a557de472e6" returned: 0 in 0.450s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:08 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-455b6da0-e19d-4eb1-bf3a-b925c7d42d4c tempest-AttachVolumeNegativeTest-324058728 None] Lock "cinder-quobyte-963f31b4-6566-40f9-9062-6a557de472e6" released by "delete_volume" :: held 1.094s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:14:08 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-455b6da0-e19d-4eb1-bf3a-b925c7d42d4c tempest-AttachVolumeNegativeTest-324058728 None] Created reservations ['6f570135-dfa5-4d29-aec1-f17734aafdbc', '61bab083-18c6-4dfd-bb5a-4b7f255ed1c8', '1295b73e-6d0b-41ca-b38f-fac6bf656a04', '12ab2d5c-bc6e-416c-b91e-f27761d85e2f'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:14:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-455b6da0-e19d-4eb1-bf3a-b925c7d42d4c tempest-AttachVolumeNegativeTest-324058728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:14:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-455b6da0-e19d-4eb1-bf3a-b925c7d42d4c tempest-AttachVolumeNegativeTest-324058728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:14:08 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-455b6da0-e19d-4eb1-bf3a-b925c7d42d4c tempest-AttachVolumeNegativeTest-324058728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:14:08 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-455b6da0-e19d-4eb1-bf3a-b925c7d42d4c tempest-AttachVolumeNegativeTest-324058728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:14:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-455b6da0-e19d-4eb1-bf3a-b925c7d42d4c tempest-AttachVolumeNegativeTest-324058728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:14:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-455b6da0-e19d-4eb1-bf3a-b925c7d42d4c tempest-AttachVolumeNegativeTest-324058728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:08 devstack sudo[100495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:14:08 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:09 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-455b6da0-e19d-4eb1-bf3a-b925c7d42d4c tempest-AttachVolumeNegativeTest-324058728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.440s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:09 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-455b6da0-e19d-4eb1-bf3a-b925c7d42d4c tempest-AttachVolumeNegativeTest-324058728 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:14:09 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-455b6da0-e19d-4eb1-bf3a-b925c7d42d4c tempest-AttachVolumeNegativeTest-324058728 None] Deleted volume successfully.
Nov 19 13:14:09 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-455b6da0-e19d-4eb1-bf3a-b925c7d42d4c tempest-AttachVolumeNegativeTest-324058728 None] Lock "cinder-963f31b4-6566-40f9-9062-6a557de472e6-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:14:09 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5994c41e-c76b-450e-a981-86c228a1121f tempest-AttachVolumeNegativeTest-324058728 None] Acquiring lock "cinder-ba049027-3b4c-4a76-bd70-7461b1910d36-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:14:09 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5994c41e-c76b-450e-a981-86c228a1121f tempest-AttachVolumeNegativeTest-324058728 None] Lock "cinder-ba049027-3b4c-4a76-bd70-7461b1910d36-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:14:09 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5994c41e-c76b-450e-a981-86c228a1121f tempest-AttachVolumeNegativeTest-324058728 None] Acquiring lock "cinder-quobyte-ba049027-3b4c-4a76-bd70-7461b1910d36" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:14:09 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5994c41e-c76b-450e-a981-86c228a1121f tempest-AttachVolumeNegativeTest-324058728 None] Lock "cinder-quobyte-ba049027-3b4c-4a76-bd70-7461b1910d36" acquired by "delete_volume" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:14:09 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96fa13c-4f84-46b6-a4cb-9c654e3a8956]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:14:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5994c41e-c76b-450e-a981-86c228a1121f tempest-AttachVolumeNegativeTest-324058728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ba049027-3b4c-4a76-bd70-7461b1910d36 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:10 devstack sudo[100498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ba049027-3b4c-4a76-bd70-7461b1910d36
Nov 19 13:14:10 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:10 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5994c41e-c76b-450e-a981-86c228a1121f tempest-AttachVolumeNegativeTest-324058728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ba049027-3b4c-4a76-bd70-7461b1910d36" returned: 0 in 0.578s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5994c41e-c76b-450e-a981-86c228a1121f tempest-AttachVolumeNegativeTest-324058728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ba049027-3b4c-4a76-bd70-7461b1910d36 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:10 devstack sudo[100503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ba049027-3b4c-4a76-bd70-7461b1910d36
Nov 19 13:14:10 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:11 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5994c41e-c76b-450e-a981-86c228a1121f tempest-AttachVolumeNegativeTest-324058728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ba049027-3b4c-4a76-bd70-7461b1910d36" returned: 0 in 0.546s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:11 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5994c41e-c76b-450e-a981-86c228a1121f tempest-AttachVolumeNegativeTest-324058728 None] Lock "cinder-quobyte-ba049027-3b4c-4a76-bd70-7461b1910d36" released by "delete_volume" :: held 1.153s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:14:11 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-5994c41e-c76b-450e-a981-86c228a1121f tempest-AttachVolumeNegativeTest-324058728 None] Created reservations ['d7ae55c7-3252-4061-8c28-de3532fd59ff', 'd891b7ad-f18c-42a7-80e2-9a357bd1f476', '286327de-850d-4fd6-a36b-d109a4e49267', '8244a66c-06df-4f2f-9e0e-ca759883b246'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:14:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5994c41e-c76b-450e-a981-86c228a1121f tempest-AttachVolumeNegativeTest-324058728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:14:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5994c41e-c76b-450e-a981-86c228a1121f tempest-AttachVolumeNegativeTest-324058728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:14:11 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5994c41e-c76b-450e-a981-86c228a1121f tempest-AttachVolumeNegativeTest-324058728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:14:11 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5994c41e-c76b-450e-a981-86c228a1121f tempest-AttachVolumeNegativeTest-324058728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:14:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5994c41e-c76b-450e-a981-86c228a1121f tempest-AttachVolumeNegativeTest-324058728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:14:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5994c41e-c76b-450e-a981-86c228a1121f tempest-AttachVolumeNegativeTest-324058728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:11 devstack sudo[100506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:14:11 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:11 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5994c41e-c76b-450e-a981-86c228a1121f tempest-AttachVolumeNegativeTest-324058728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.481s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:11 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-5994c41e-c76b-450e-a981-86c228a1121f tempest-AttachVolumeNegativeTest-324058728 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:14:11 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-5994c41e-c76b-450e-a981-86c228a1121f tempest-AttachVolumeNegativeTest-324058728 None] Deleted volume successfully.
Nov 19 13:14:11 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5994c41e-c76b-450e-a981-86c228a1121f tempest-AttachVolumeNegativeTest-324058728 None] Lock "cinder-ba049027-3b4c-4a76-bd70-7461b1910d36-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:14:13 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:14:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Flow 'volume_create_manager' (cf53eb74-fa96-4d3e-a735-22d5773c4bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:14:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b8a27b-40a5-405b-87b0-3f21b15d4ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b8a27b-40a5-405b-87b0-3f21b15d4ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1946852793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30258c6d-5972-4d20-bfc8-2573ffc78291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2112980f8474664acf756ce9238e8f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:14:13Z,use_quota=True,user_id='b03c917ebf6e4460b8b11340aae3f904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1fa600a-9248-4f45-a21b-6d594d20225f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1fa600a-9248-4f45-a21b-6d594d20225f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5681c8fa-951a-490c-9ae4-ca684dfedc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5681c8fa-951a-490c-9ae4-ca684dfedc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30258c6d-5972-4d20-bfc8-2573ffc78291', 'volume_name': 'volume-30258c6d-5972-4d20-bfc8-2573ffc78291', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d5a25a6-2919-447d-9b63-cdb3e57f7337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d5a25a6-2919-447d-9b63-cdb3e57f7337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c5a41a-8789-4518-afca-d5e3c49bd987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:13 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Volume 30258c6d-5972-4d20-bfc8-2573ffc78291: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30258c6d-5972-4d20-bfc8-2573ffc78291', 'volume_size': 1}
Nov 19 13:14:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:14:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:14:13 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1946852793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30258c6d-5972-4d20-bfc8-2573ffc78291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2112980f8474664acf756ce9238e8f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:14:13Z,use_quota=True,user_id='b03c917ebf6e4460b8b11340aae3f904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:14:13 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Creating volume 30258c6d-5972-4d20-bfc8-2573ffc78291 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:14:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:14:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:14:13 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:14:13 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:14:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:14:13 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:14:13 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:14:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:13 devstack sudo[100510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291 1073741824
Nov 19 13:14:13 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:14 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291 1073741824" returned: 0 in 0.570s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:14 devstack sudo[100516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291
Nov 19 13:14:14 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:14 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291" returned: 0 in 0.536s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:14 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:14:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:14:14 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c5a41a-8789-4518-afca-d5e3c49bd987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30258c6d-5972-4d20-bfc8-2573ffc78291', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:14 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5f400e6-8dcd-4a94-83e0-65cf2c41bcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:14 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Volume volume-30258c6d-5972-4d20-bfc8-2573ffc78291 (30258c6d-5972-4d20-bfc8-2573ffc78291): created successfully
Nov 19 13:14:14 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5f400e6-8dcd-4a94-83e0-65cf2c41bcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:14 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Flow 'volume_create_manager' (cf53eb74-fa96-4d3e-a735-22d5773c4bf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:14:14 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-18533e80-6061-47fd-a6d2-60b4136b2e8a tempest-SnapshotDependencyTests-341945119 None] Created volume successfully.
Nov 19 13:14:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-53975c24-e386-432d-8849-afa644a17b97 tempest-SnapshotDependencyTests-341945119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:14:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-53975c24-e386-432d-8849-afa644a17b97 tempest-SnapshotDependencyTests-341945119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:14:15 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-53975c24-e386-432d-8849-afa644a17b97 tempest-SnapshotDependencyTests-341945119 None] Creating offline snapshot 978147f1-e86f-4d0c-8b09-d85f24db32e5 of volume 30258c6d-5972-4d20-bfc8-2573ffc78291 {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 13:14:15 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b2bde1-5c41-4603-b7c5-752f1f7dc89a]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:14:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-53975c24-e386-432d-8849-afa644a17b97 tempest-SnapshotDependencyTests-341945119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:15 devstack sudo[100519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291
Nov 19 13:14:15 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:16 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-53975c24-e386-432d-8849-afa644a17b97 tempest-SnapshotDependencyTests-341945119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291" returned: 0 in 0.587s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-53975c24-e386-432d-8849-afa644a17b97 tempest-SnapshotDependencyTests-341945119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.978147f1-e86f-4d0c-8b09-d85f24db32e5 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:16 devstack sudo[100525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.978147f1-e86f-4d0c-8b09-d85f24db32e5 1G
Nov 19 13:14:16 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:16 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-53975c24-e386-432d-8849-afa644a17b97 tempest-SnapshotDependencyTests-341945119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.978147f1-e86f-4d0c-8b09-d85f24db32e5 1G" returned: 0 in 0.559s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-53975c24-e386-432d-8849-afa644a17b97 tempest-SnapshotDependencyTests-341945119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30258c6d-5972-4d20-bfc8-2573ffc78291 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.978147f1-e86f-4d0c-8b09-d85f24db32e5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:16 devstack sudo[100530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30258c6d-5972-4d20-bfc8-2573ffc78291 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.978147f1-e86f-4d0c-8b09-d85f24db32e5
Nov 19 13:14:16 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:17 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-53975c24-e386-432d-8849-afa644a17b97 tempest-SnapshotDependencyTests-341945119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30258c6d-5972-4d20-bfc8-2573ffc78291 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.978147f1-e86f-4d0c-8b09-d85f24db32e5" returned: 0 in 0.502s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:17 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-53975c24-e386-432d-8849-afa644a17b97 tempest-SnapshotDependencyTests-341945119 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.978147f1-e86f-4d0c-8b09-d85f24db32e5 is being set with open permissions: ugo+rw
Nov 19 13:14:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-53975c24-e386-432d-8849-afa644a17b97 tempest-SnapshotDependencyTests-341945119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.978147f1-e86f-4d0c-8b09-d85f24db32e5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:17 devstack sudo[100535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.978147f1-e86f-4d0c-8b09-d85f24db32e5
Nov 19 13:14:17 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:17 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-9ef3efc6-0b37-4c49-ab07-ac3f1b100e1d tempest-GroupsTest-1103387332 None] Group tempest-Group1-739392484: creating
Nov 19 13:14:17 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-9ef3efc6-0b37-4c49-ab07-ac3f1b100e1d tempest-GroupsTest-1103387332 None] Group tempest-Group1-739392484: created successfully
Nov 19 13:14:17 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-9ef3efc6-0b37-4c49-ab07-ac3f1b100e1d tempest-GroupsTest-1103387332 None] Create group completed successfully.
Nov 19 13:14:17 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-53975c24-e386-432d-8849-afa644a17b97 tempest-SnapshotDependencyTests-341945119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.978147f1-e86f-4d0c-8b09-d85f24db32e5" returned: 0 in 0.532s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-53975c24-e386-432d-8849-afa644a17b97 tempest-SnapshotDependencyTests-341945119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:17 devstack sudo[100538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.info
Nov 19 13:14:17 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:18 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-53975c24-e386-432d-8849-afa644a17b97 tempest-SnapshotDependencyTests-341945119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.info" returned: 0 in 0.468s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:18 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-53975c24-e386-432d-8849-afa644a17b97 tempest-SnapshotDependencyTests-341945119 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.info is being set with open permissions: ugo+rw
Nov 19 13:14:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-53975c24-e386-432d-8849-afa644a17b97 tempest-SnapshotDependencyTests-341945119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:18 devstack sudo[100541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.info
Nov 19 13:14:18 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:18 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-53975c24-e386-432d-8849-afa644a17b97 tempest-SnapshotDependencyTests-341945119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.info" returned: 0 in 0.426s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-53975c24-e386-432d-8849-afa644a17b97 tempest-SnapshotDependencyTests-341945119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.134s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:14:18 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-53975c24-e386-432d-8849-afa644a17b97 tempest-SnapshotDependencyTests-341945119 None] Create snapshot completed successfully
Nov 19 13:14:19 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-9230f089-39b6-4010-8739-a95228774b05 tempest-GroupsTest-1103387332 None] Group tempest-Group2-29697783: creating
Nov 19 13:14:19 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-9230f089-39b6-4010-8739-a95228774b05 tempest-GroupsTest-1103387332 None] Group tempest-Group2-29697783: created successfully
Nov 19 13:14:19 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-9230f089-39b6-4010-8739-a95228774b05 tempest-GroupsTest-1103387332 None] Create group completed successfully.
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Flow 'volume_create_manager' (3b5f6814-abee-4a1e-bc93-49f0acf6c0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47b06c9-2ab3-4e9c-adba-fb194d39d684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47b06c9-2ab3-4e9c-adba-fb194d39d684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2870f6df-4efd-4fa3-8877-735d1f09127f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2112980f8474664acf756ce9238e8f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=978147f1-e86f-4d0c-8b09-d85f24db32e5,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:14:20Z,use_quota=True,user_id='b03c917ebf6e4460b8b11340aae3f904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177fb797-88af-4193-9813-650d905e09f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177fb797-88af-4193-9813-650d905e09f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f4d8f94-8da8-429c-99c4-a919437dbcec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f4d8f94-8da8-429c-99c4-a919437dbcec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2870f6df-4efd-4fa3-8877-735d1f09127f', 'volume_name': 'volume-2870f6df-4efd-4fa3-8877-735d1f09127f', 'volume_size': 1, 'snapshot_id': '978147f1-e86f-4d0c-8b09-d85f24db32e5'}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae36bc0c-e48e-4600-a169-01a57287b783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae36bc0c-e48e-4600-a169-01a57287b783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12718a10-2241-4596-97b7-daa6e0550fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:20 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Volume 2870f6df-4efd-4fa3-8877-735d1f09127f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2870f6df-4efd-4fa3-8877-735d1f09127f', 'volume_size': 1, 'snapshot_id': '978147f1-e86f-4d0c-8b09-d85f24db32e5'}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Acquiring lock "cinder-quobyte-978147f1-e86f-4d0c-8b09-d85f24db32e5-2870f6df-4efd-4fa3-8877-735d1f09127f" by "_create_volume_from_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Lock "cinder-quobyte-978147f1-e86f-4d0c-8b09-d85f24db32e5-2870f6df-4efd-4fa3-8877-735d1f09127f" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Creating volume 2870f6df-4efd-4fa3-8877-735d1f09127f from snapshot 978147f1-e86f-4d0c-8b09-d85f24db32e5 {{(pid=80839) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Acquiring lock "cinder-quobyte-2870f6df-4efd-4fa3-8877-735d1f09127f" by "_copy_volume_from_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Lock "cinder-quobyte-2870f6df-4efd-4fa3-8877-735d1f09127f" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] snapshot: 978147f1-e86f-4d0c-8b09-d85f24db32e5, volume: 2870f6df-4efd-4fa3-8877-735d1f09127f,  {{(pid=80839) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:392}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa5777e-5b14-4cab-9fda-8026c00ae5e8]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.978147f1-e86f-4d0c-8b09-d85f24db32e5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Flow 'volume_create_manager' (63ac9aa9-4b64-44a0-88f8-33827e13bc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f096228b-3da1-409d-a143-ae850020fa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f096228b-3da1-409d-a143-ae850020fa71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-446851967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=48f24a5f-508e-457b-9fc1-44ae19b7337d,host='devstack@QuobyteHD#QuobyteHD',id=55b27ca2-929b-47d8-bf93-63c692a86b24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09680b87bc194eb9a7440b417442d7f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:14:20Z,use_quota=True,user_id='4923d22c426949aa9223c6d98c9bf4c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0284fa3f-55bb-4871-ac0d-5a56a4a1b135),volume_type_id=0284fa3f-55bb-4871-ac0d-5a56a4a1b135)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac2966e-135f-494e-8b0a-cd7bc253a9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac2966e-135f-494e-8b0a-cd7bc253a9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49118070-f512-474d-89ad-7257e9e7cbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49118070-f512-474d-89ad-7257e9e7cbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55b27ca2-929b-47d8-bf93-63c692a86b24', 'volume_name': 'volume-55b27ca2-929b-47d8-bf93-63c692a86b24', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a8a0e86-6721-4dd8-8579-8dd4125807cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a8a0e86-6721-4dd8-8579-8dd4125807cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e8b335e-af0d-4b3e-bb1c-00c67f005e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:20 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Volume 55b27ca2-929b-47d8-bf93-63c692a86b24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55b27ca2-929b-47d8-bf93-63c692a86b24', 'volume_size': 1}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:14:20 devstack sudo[100544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.978147f1-e86f-4d0c-8b09-d85f24db32e5
Nov 19 13:14:20 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:20 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.978147f1-e86f-4d0c-8b09-d85f24db32e5" returned: 0 in 0.525s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30258c6d-5972-4d20-bfc8-2573ffc78291(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291 {{(pid=80839) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:411}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Creating direct copy from snapshot {{(pid=80839) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:419}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[da30381f-1655-484d-8c75-fba152404342]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:14:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:20 devstack sudo[100549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291
Nov 19 13:14:20 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:21 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291" returned: 0 in 0.539s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:21 devstack cinder-volume[80839]: DEBUG cinder.utils [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Path /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2870f6df-4efd-4fa3-8877-735d1f09127f not found in is_blk_device check {{(pid=80839) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Nov 19 13:14:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2870f6df-4efd-4fa3-8877-735d1f09127f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:21 devstack sudo[100554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2870f6df-4efd-4fa3-8877-735d1f09127f
Nov 19 13:14:21 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:23 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2870f6df-4efd-4fa3-8877-735d1f09127f" returned: 0 in 1.862s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:23 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e01d0a-b46c-4467-a67c-4fb9763a3971]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:14:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:23 devstack sudo[100567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291
Nov 19 13:14:23 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:23 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291" returned: 0 in 0.659s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:23 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Image conversion details: src /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291, size 1024.00 MB, duration 1.86 sec, destination /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2870f6df-4efd-4fa3-8877-735d1f09127f {{(pid=80839) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 19 13:14:23 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Converted 1024.00 MB image at 549.65 MB/s
Nov 19 13:14:23 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2870f6df-4efd-4fa3-8877-735d1f09127f is being set with open permissions: ugo+rw
Nov 19 13:14:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2870f6df-4efd-4fa3-8877-735d1f09127f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:23 devstack sudo[100572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2870f6df-4efd-4fa3-8877-735d1f09127f
Nov 19 13:14:23 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:24 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2870f6df-4efd-4fa3-8877-735d1f09127f" returned: 0 in 0.455s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Lock "cinder-quobyte-2870f6df-4efd-4fa3-8877-735d1f09127f" released by "_copy_volume_from_snapshot" :: held 4.111s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:14:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Lock "cinder-quobyte-978147f1-e86f-4d0c-8b09-d85f24db32e5-2870f6df-4efd-4fa3-8877-735d1f09127f" released by "_create_volume_from_snapshot" :: held 4.130s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:14:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.140s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:14:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.982s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:14:24 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=48f24a5f-508e-457b-9fc1-44ae19b7337d,created_at=2025-11-19T12:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-446851967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=48f24a5f-508e-457b-9fc1-44ae19b7337d,host='devstack@QuobyteHD#QuobyteHD',id=55b27ca2-929b-47d8-bf93-63c692a86b24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09680b87bc194eb9a7440b417442d7f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:14:20Z,use_quota=True,user_id='4923d22c426949aa9223c6d98c9bf4c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0284fa3f-55bb-4871-ac0d-5a56a4a1b135),volume_type_id=0284fa3f-55bb-4871-ac0d-5a56a4a1b135)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:14:24 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Creating volume 55b27ca2-929b-47d8-bf93-63c692a86b24 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:14:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:14:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:14:24 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:14:24 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:14:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:14:24 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:14:24 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:14:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-55b27ca2-929b-47d8-bf93-63c692a86b24 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:24 devstack sudo[100575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-55b27ca2-929b-47d8-bf93-63c692a86b24 1073741824
Nov 19 13:14:24 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:24 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12718a10-2241-4596-97b7-daa6e0550fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2870f6df-4efd-4fa3-8877-735d1f09127f', 'volume_size': 1, 'snapshot_id': '978147f1-e86f-4d0c-8b09-d85f24db32e5'}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:24 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3715e68-193d-4bd5-bf1e-6755c4de2663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:24 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Volume volume-2870f6df-4efd-4fa3-8877-735d1f09127f (2870f6df-4efd-4fa3-8877-735d1f09127f): created successfully
Nov 19 13:14:24 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3715e68-193d-4bd5-bf1e-6755c4de2663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:24 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Flow 'volume_create_manager' (3b5f6814-abee-4a1e-bc93-49f0acf6c0d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:14:24 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-6549154b-357e-4dde-8e99-28895004598e tempest-SnapshotDependencyTests-341945119 None] Created volume successfully.
Nov 19 13:14:24 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-55b27ca2-929b-47d8-bf93-63c692a86b24 1073741824" returned: 0 in 0.517s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-55b27ca2-929b-47d8-bf93-63c692a86b24 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:24 devstack sudo[100580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-55b27ca2-929b-47d8-bf93-63c692a86b24
Nov 19 13:14:24 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:25 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-55b27ca2-929b-47d8-bf93-63c692a86b24" returned: 0 in 0.441s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:25 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:14:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:14:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e8b335e-af0d-4b3e-bb1c-00c67f005e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55b27ca2-929b-47d8-bf93-63c692a86b24', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (747919e6-0ab9-4b33-b904-266f90358c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:25 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Volume volume-55b27ca2-929b-47d8-bf93-63c692a86b24 (55b27ca2-929b-47d8-bf93-63c692a86b24): created successfully
Nov 19 13:14:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (747919e6-0ab9-4b33-b904-266f90358c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Flow 'volume_create_manager' (63ac9aa9-4b64-44a0-88f8-33827e13bc90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:14:25 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-bff72bd2-5891-4cf3-b70e-3b884bc50468 tempest-GroupsTest-1103387332 None] Created volume successfully.
Nov 19 13:14:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f207acd1-46b1-4097-82d6-c1304cd6ed39 tempest-SnapshotDependencyTests-341945119 None] Acquiring lock "cinder-978147f1-e86f-4d0c-8b09-d85f24db32e5-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:14:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f207acd1-46b1-4097-82d6-c1304cd6ed39 tempest-SnapshotDependencyTests-341945119 None] Lock "cinder-978147f1-e86f-4d0c-8b09-d85f24db32e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:14:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f207acd1-46b1-4097-82d6-c1304cd6ed39 tempest-SnapshotDependencyTests-341945119 None] Acquiring lock "cinder-quobyte-30258c6d-5972-4d20-bfc8-2573ffc78291" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:14:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f207acd1-46b1-4097-82d6-c1304cd6ed39 tempest-SnapshotDependencyTests-341945119 None] Lock "cinder-quobyte-30258c6d-5972-4d20-bfc8-2573ffc78291" acquired by "delete_snapshot" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:14:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f207acd1-46b1-4097-82d6-c1304cd6ed39 tempest-SnapshotDependencyTests-341945119 None] Acquiring lock "cinder-quobyte-978147f1-e86f-4d0c-8b09-d85f24db32e5" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:14:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f207acd1-46b1-4097-82d6-c1304cd6ed39 tempest-SnapshotDependencyTests-341945119 None] Lock "cinder-quobyte-978147f1-e86f-4d0c-8b09-d85f24db32e5" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:14:25 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-f207acd1-46b1-4097-82d6-c1304cd6ed39 tempest-SnapshotDependencyTests-341945119 None] Deleting offline snapshot 978147f1-e86f-4d0c-8b09-d85f24db32e5 of volume 30258c6d-5972-4d20-bfc8-2573ffc78291 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 13:14:25 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-f207acd1-46b1-4097-82d6-c1304cd6ed39 tempest-SnapshotDependencyTests-341945119 None] snapshot_file for this snap is: volume-30258c6d-5972-4d20-bfc8-2573ffc78291.978147f1-e86f-4d0c-8b09-d85f24db32e5 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 13:14:25 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[727f697a-bc19-42a3-80fc-8389884a6c50]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:14:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f207acd1-46b1-4097-82d6-c1304cd6ed39 tempest-SnapshotDependencyTests-341945119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.978147f1-e86f-4d0c-8b09-d85f24db32e5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:25 devstack sudo[100583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.978147f1-e86f-4d0c-8b09-d85f24db32e5
Nov 19 13:14:25 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a9cb3f3a-2c2a-48f2-8747-26c221a2e45f tempest-GroupsTest-1103387332 None] Acquiring lock "cinder-quobyte-55b27ca2-929b-47d8-bf93-63c692a86b24" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:14:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a9cb3f3a-2c2a-48f2-8747-26c221a2e45f tempest-GroupsTest-1103387332 None] Lock "cinder-quobyte-55b27ca2-929b-47d8-bf93-63c692a86b24" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:14:26 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1a0948-8909-4b56-939e-a6bb49a62f67]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:14:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a9cb3f3a-2c2a-48f2-8747-26c221a2e45f tempest-GroupsTest-1103387332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-55b27ca2-929b-47d8-bf93-63c692a86b24 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:26 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f207acd1-46b1-4097-82d6-c1304cd6ed39 tempest-SnapshotDependencyTests-341945119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.978147f1-e86f-4d0c-8b09-d85f24db32e5" returned: 0 in 0.564s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-f207acd1-46b1-4097-82d6-c1304cd6ed39 tempest-SnapshotDependencyTests-341945119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30258c6d-5972-4d20-bfc8-2573ffc78291(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:14:26 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6055dce0-d479-4613-a760-462a7bf345d9]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:14:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f207acd1-46b1-4097-82d6-c1304cd6ed39 tempest-SnapshotDependencyTests-341945119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:26 devstack sudo[100588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-55b27ca2-929b-47d8-bf93-63c692a86b24
Nov 19 13:14:26 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:26 devstack sudo[100589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291
Nov 19 13:14:26 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:26 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a9cb3f3a-2c2a-48f2-8747-26c221a2e45f tempest-GroupsTest-1103387332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-55b27ca2-929b-47d8-bf93-63c692a86b24" returned: 0 in 0.557s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a9cb3f3a-2c2a-48f2-8747-26c221a2e45f tempest-GroupsTest-1103387332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-55b27ca2-929b-47d8-bf93-63c692a86b24 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:26 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f207acd1-46b1-4097-82d6-c1304cd6ed39 tempest-SnapshotDependencyTests-341945119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291" returned: 0 in 0.526s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:26 devstack sudo[100598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-55b27ca2-929b-47d8-bf93-63c692a86b24
Nov 19 13:14:26 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f207acd1-46b1-4097-82d6-c1304cd6ed39 tempest-SnapshotDependencyTests-341945119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.978147f1-e86f-4d0c-8b09-d85f24db32e5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:26 devstack sudo[100600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.978147f1-e86f-4d0c-8b09-d85f24db32e5
Nov 19 13:14:26 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:27 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a9cb3f3a-2c2a-48f2-8747-26c221a2e45f tempest-GroupsTest-1103387332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-55b27ca2-929b-47d8-bf93-63c692a86b24" returned: 0 in 0.425s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:27 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a9cb3f3a-2c2a-48f2-8747-26c221a2e45f tempest-GroupsTest-1103387332 None] Lock "cinder-quobyte-55b27ca2-929b-47d8-bf93-63c692a86b24" released by "delete_volume" :: held 1.002s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:14:27 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-a9cb3f3a-2c2a-48f2-8747-26c221a2e45f tempest-GroupsTest-1103387332 None] Created reservations ['4e255287-7830-43ac-a51a-e5a4bb799d45'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:14:27 devstack cinder-volume[80839]: WARNING cinder.quota [None req-a9cb3f3a-2c2a-48f2-8747-26c221a2e45f tempest-GroupsTest-1103387332 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2134216212 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2134216212, it is now deprecated. Please use the default quota class for default quota.
Nov 19 13:14:27 devstack cinder-volume[80839]: WARNING cinder.quota [None req-a9cb3f3a-2c2a-48f2-8747-26c221a2e45f tempest-GroupsTest-1103387332 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2134216212 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2134216212, it is now deprecated. Please use the default quota class for default quota.
Nov 19 13:14:27 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-a9cb3f3a-2c2a-48f2-8747-26c221a2e45f tempest-GroupsTest-1103387332 None] Created reservations ['c7054dd9-a880-41ce-a2ed-75e19a6c3b12', '0d40bb7c-d2c8-42d1-aca0-23eb4f06b475', '90ccd159-c23a-4443-ba98-02a05ea19cf8', 'f1ebd505-fd76-4d08-81fc-92cd6ef33c6d'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:14:27 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f207acd1-46b1-4097-82d6-c1304cd6ed39 tempest-SnapshotDependencyTests-341945119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.978147f1-e86f-4d0c-8b09-d85f24db32e5" returned: 0 in 0.510s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f207acd1-46b1-4097-82d6-c1304cd6ed39 tempest-SnapshotDependencyTests-341945119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.978147f1-e86f-4d0c-8b09-d85f24db32e5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:27 devstack sudo[100606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.978147f1-e86f-4d0c-8b09-d85f24db32e5
Nov 19 13:14:27 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a9cb3f3a-2c2a-48f2-8747-26c221a2e45f tempest-GroupsTest-1103387332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:14:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a9cb3f3a-2c2a-48f2-8747-26c221a2e45f tempest-GroupsTest-1103387332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:14:27 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a9cb3f3a-2c2a-48f2-8747-26c221a2e45f tempest-GroupsTest-1103387332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:14:27 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a9cb3f3a-2c2a-48f2-8747-26c221a2e45f tempest-GroupsTest-1103387332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:14:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a9cb3f3a-2c2a-48f2-8747-26c221a2e45f tempest-GroupsTest-1103387332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:14:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a9cb3f3a-2c2a-48f2-8747-26c221a2e45f tempest-GroupsTest-1103387332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:27 devstack sudo[100608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:14:27 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:27 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f207acd1-46b1-4097-82d6-c1304cd6ed39 tempest-SnapshotDependencyTests-341945119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291.978147f1-e86f-4d0c-8b09-d85f24db32e5" returned: 0 in 0.438s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:27 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f207acd1-46b1-4097-82d6-c1304cd6ed39 tempest-SnapshotDependencyTests-341945119 None] Lock "cinder-quobyte-978147f1-e86f-4d0c-8b09-d85f24db32e5" released by "_delete_snapshot" :: held 2.101s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:14:27 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f207acd1-46b1-4097-82d6-c1304cd6ed39 tempest-SnapshotDependencyTests-341945119 None] Lock "cinder-quobyte-30258c6d-5972-4d20-bfc8-2573ffc78291" released by "delete_snapshot" :: held 2.113s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:14:27 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a9cb3f3a-2c2a-48f2-8747-26c221a2e45f tempest-GroupsTest-1103387332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.438s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:27 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-a9cb3f3a-2c2a-48f2-8747-26c221a2e45f tempest-GroupsTest-1103387332 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:14:27 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-f207acd1-46b1-4097-82d6-c1304cd6ed39 tempest-SnapshotDependencyTests-341945119 None] Created reservations ['fe85cf67-8eaf-4a40-a3f4-cf35b5d7bf21', '79e174e9-6502-4994-ab2f-9ddc6c29f061', 'f4395874-a64f-426a-8739-a0684fc14148', '1984dbe6-3693-4d8c-9c40-a9200f1ae7ae'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:14:27 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-a9cb3f3a-2c2a-48f2-8747-26c221a2e45f tempest-GroupsTest-1103387332 None] Delete group completed successfully.
Nov 19 13:14:27 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-f207acd1-46b1-4097-82d6-c1304cd6ed39 tempest-SnapshotDependencyTests-341945119 None] Delete snapshot completed successfully.
Nov 19 13:14:27 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f207acd1-46b1-4097-82d6-c1304cd6ed39 tempest-SnapshotDependencyTests-341945119 None] Lock "cinder-978147f1-e86f-4d0c-8b09-d85f24db32e5-delete_snapshot" released by "delete_snapshot" :: held 2.202s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:14:28 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-7cdf22b6-637f-4401-b60c-77dc6afc942c tempest-GroupsTest-1103387332 None] Created reservations ['84945121-14ae-4c07-b89f-810e6f33fa60'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:14:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7cdf22b6-637f-4401-b60c-77dc6afc942c tempest-GroupsTest-1103387332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:14:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7cdf22b6-637f-4401-b60c-77dc6afc942c tempest-GroupsTest-1103387332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:14:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7cdf22b6-637f-4401-b60c-77dc6afc942c tempest-GroupsTest-1103387332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:14:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7cdf22b6-637f-4401-b60c-77dc6afc942c tempest-GroupsTest-1103387332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:14:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7cdf22b6-637f-4401-b60c-77dc6afc942c tempest-GroupsTest-1103387332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:14:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7cdf22b6-637f-4401-b60c-77dc6afc942c tempest-GroupsTest-1103387332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:28 devstack sudo[100612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:14:28 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:28 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6fd1afc2-3e30-4efc-88e9-ef1e2fa7d270 tempest-SnapshotDependencyTests-341945119 None] Acquiring lock "cinder-30258c6d-5972-4d20-bfc8-2573ffc78291-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:14:28 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6fd1afc2-3e30-4efc-88e9-ef1e2fa7d270 tempest-SnapshotDependencyTests-341945119 None] Lock "cinder-30258c6d-5972-4d20-bfc8-2573ffc78291-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:14:28 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6fd1afc2-3e30-4efc-88e9-ef1e2fa7d270 tempest-SnapshotDependencyTests-341945119 None] Acquiring lock "cinder-quobyte-30258c6d-5972-4d20-bfc8-2573ffc78291" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:14:28 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6fd1afc2-3e30-4efc-88e9-ef1e2fa7d270 tempest-SnapshotDependencyTests-341945119 None] Lock "cinder-quobyte-30258c6d-5972-4d20-bfc8-2573ffc78291" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:14:28 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[886b5682-53e4-442f-b33b-15efdf3248c1]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:14:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6fd1afc2-3e30-4efc-88e9-ef1e2fa7d270 tempest-SnapshotDependencyTests-341945119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:28 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7cdf22b6-637f-4401-b60c-77dc6afc942c tempest-GroupsTest-1103387332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.456s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:28 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-7cdf22b6-637f-4401-b60c-77dc6afc942c tempest-GroupsTest-1103387332 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:14:28 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-7cdf22b6-637f-4401-b60c-77dc6afc942c tempest-GroupsTest-1103387332 None] Delete group completed successfully.
Nov 19 13:14:28 devstack sudo[100615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291
Nov 19 13:14:28 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:29 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6fd1afc2-3e30-4efc-88e9-ef1e2fa7d270 tempest-SnapshotDependencyTests-341945119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291" returned: 0 in 0.531s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6fd1afc2-3e30-4efc-88e9-ef1e2fa7d270 tempest-SnapshotDependencyTests-341945119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:29 devstack sudo[100620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291
Nov 19 13:14:29 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:29 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-8967d415-4c3c-4ada-a12c-0e911d410b78 tempest-GroupsTest-1103387332 None] Group tempest-GroupsTest-Group-1954121306: creating
Nov 19 13:14:29 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-8967d415-4c3c-4ada-a12c-0e911d410b78 tempest-GroupsTest-1103387332 None] Group tempest-GroupsTest-Group-1954121306: created successfully
Nov 19 13:14:29 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-8967d415-4c3c-4ada-a12c-0e911d410b78 tempest-GroupsTest-1103387332 None] Create group completed successfully.
Nov 19 13:14:29 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6fd1afc2-3e30-4efc-88e9-ef1e2fa7d270 tempest-SnapshotDependencyTests-341945119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-30258c6d-5972-4d20-bfc8-2573ffc78291" returned: 0 in 0.481s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:29 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6fd1afc2-3e30-4efc-88e9-ef1e2fa7d270 tempest-SnapshotDependencyTests-341945119 None] Lock "cinder-quobyte-30258c6d-5972-4d20-bfc8-2573ffc78291" released by "delete_volume" :: held 1.063s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:14:29 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-6fd1afc2-3e30-4efc-88e9-ef1e2fa7d270 tempest-SnapshotDependencyTests-341945119 None] Created reservations ['fa0a856b-5591-473e-9f56-a1be0a76ed7e', '4c3d506b-6be7-45b2-b5da-07e5e4e83ac8', 'ed45f7b2-03c5-4b3b-8851-4e79e6e9f596', '1ccbc34f-22d6-4a03-98dc-066230956470'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:14:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6fd1afc2-3e30-4efc-88e9-ef1e2fa7d270 tempest-SnapshotDependencyTests-341945119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:14:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6fd1afc2-3e30-4efc-88e9-ef1e2fa7d270 tempest-SnapshotDependencyTests-341945119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:14:29 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6fd1afc2-3e30-4efc-88e9-ef1e2fa7d270 tempest-SnapshotDependencyTests-341945119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:14:29 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6fd1afc2-3e30-4efc-88e9-ef1e2fa7d270 tempest-SnapshotDependencyTests-341945119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:14:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6fd1afc2-3e30-4efc-88e9-ef1e2fa7d270 tempest-SnapshotDependencyTests-341945119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:14:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6fd1afc2-3e30-4efc-88e9-ef1e2fa7d270 tempest-SnapshotDependencyTests-341945119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:29 devstack sudo[100623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:14:29 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:30 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6fd1afc2-3e30-4efc-88e9-ef1e2fa7d270 tempest-SnapshotDependencyTests-341945119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.438s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:30 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-6fd1afc2-3e30-4efc-88e9-ef1e2fa7d270 tempest-SnapshotDependencyTests-341945119 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:14:30 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-6fd1afc2-3e30-4efc-88e9-ef1e2fa7d270 tempest-SnapshotDependencyTests-341945119 None] Deleted volume successfully.
Nov 19 13:14:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6fd1afc2-3e30-4efc-88e9-ef1e2fa7d270 tempest-SnapshotDependencyTests-341945119 None] Lock "cinder-30258c6d-5972-4d20-bfc8-2573ffc78291-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:14:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-76bebe14-1611-475a-b7ac-2e751d94d875 tempest-SnapshotDependencyTests-341945119 None] Acquiring lock "cinder-2870f6df-4efd-4fa3-8877-735d1f09127f-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:14:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-76bebe14-1611-475a-b7ac-2e751d94d875 tempest-SnapshotDependencyTests-341945119 None] Lock "cinder-2870f6df-4efd-4fa3-8877-735d1f09127f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:14:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-76bebe14-1611-475a-b7ac-2e751d94d875 tempest-SnapshotDependencyTests-341945119 None] Acquiring lock "cinder-quobyte-2870f6df-4efd-4fa3-8877-735d1f09127f" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:14:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-76bebe14-1611-475a-b7ac-2e751d94d875 tempest-SnapshotDependencyTests-341945119 None] Lock "cinder-quobyte-2870f6df-4efd-4fa3-8877-735d1f09127f" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:14:30 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a260dc1-35be-4424-a179-98258c19902f]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:14:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-76bebe14-1611-475a-b7ac-2e751d94d875 tempest-SnapshotDependencyTests-341945119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2870f6df-4efd-4fa3-8877-735d1f09127f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:31 devstack sudo[100626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2870f6df-4efd-4fa3-8877-735d1f09127f
Nov 19 13:14:31 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Flow 'volume_create_manager' (c8fb795d-6793-400b-a610-4fe3d39f2fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ea8752-474e-4a7e-83d8-410a4008fae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ea8752-474e-4a7e-83d8-410a4008fae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1512191730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=387807ee-79bb-4eb7-9859-e111c9a0e56b,host='devstack@QuobyteHD#QuobyteHD',id=2d9d0eb5-9930-4943-800b-f1678efd420a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09680b87bc194eb9a7440b417442d7f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:14:31Z,use_quota=True,user_id='4923d22c426949aa9223c6d98c9bf4c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c33ae6a-e9e2-42ef-888e-ee456f39afff),volume_type_id=1c33ae6a-e9e2-42ef-888e-ee456f39afff)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414cc830-15df-4618-a184-453ffec2d2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414cc830-15df-4618-a184-453ffec2d2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d03a243e-dc43-4d36-90eb-225c6239ca8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d03a243e-dc43-4d36-90eb-225c6239ca8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d9d0eb5-9930-4943-800b-f1678efd420a', 'volume_name': 'volume-2d9d0eb5-9930-4943-800b-f1678efd420a', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d14f97b-d2aa-49bf-825e-9d7e4704a896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d14f97b-d2aa-49bf-825e-9d7e4704a896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a74f778b-aaeb-42b3-bfab-768321d93245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:31 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Volume 2d9d0eb5-9930-4943-800b-f1678efd420a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d9d0eb5-9930-4943-800b-f1678efd420a', 'volume_size': 1}
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=387807ee-79bb-4eb7-9859-e111c9a0e56b,created_at=2025-11-19T12:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1512191730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=387807ee-79bb-4eb7-9859-e111c9a0e56b,host='devstack@QuobyteHD#QuobyteHD',id=2d9d0eb5-9930-4943-800b-f1678efd420a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09680b87bc194eb9a7440b417442d7f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:14:31Z,use_quota=True,user_id='4923d22c426949aa9223c6d98c9bf4c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c33ae6a-e9e2-42ef-888e-ee456f39afff),volume_type_id=1c33ae6a-e9e2-42ef-888e-ee456f39afff)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Creating volume 2d9d0eb5-9930-4943-800b-f1678efd420a {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:14:31 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2d9d0eb5-9930-4943-800b-f1678efd420a 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:31 devstack sudo[100628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2d9d0eb5-9930-4943-800b-f1678efd420a 1073741824
Nov 19 13:14:31 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:31 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-76bebe14-1611-475a-b7ac-2e751d94d875 tempest-SnapshotDependencyTests-341945119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2870f6df-4efd-4fa3-8877-735d1f09127f" returned: 0 in 0.562s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-76bebe14-1611-475a-b7ac-2e751d94d875 tempest-SnapshotDependencyTests-341945119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2870f6df-4efd-4fa3-8877-735d1f09127f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:31 devstack sudo[100633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2870f6df-4efd-4fa3-8877-735d1f09127f
Nov 19 13:14:31 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:31 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2d9d0eb5-9930-4943-800b-f1678efd420a 1073741824" returned: 0 in 0.532s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2d9d0eb5-9930-4943-800b-f1678efd420a {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:31 devstack sudo[100638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2d9d0eb5-9930-4943-800b-f1678efd420a
Nov 19 13:14:31 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:31 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-76bebe14-1611-475a-b7ac-2e751d94d875 tempest-SnapshotDependencyTests-341945119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2870f6df-4efd-4fa3-8877-735d1f09127f" returned: 0 in 0.470s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:31 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-76bebe14-1611-475a-b7ac-2e751d94d875 tempest-SnapshotDependencyTests-341945119 None] Lock "cinder-quobyte-2870f6df-4efd-4fa3-8877-735d1f09127f" released by "delete_volume" :: held 1.062s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:14:32 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-76bebe14-1611-475a-b7ac-2e751d94d875 tempest-SnapshotDependencyTests-341945119 None] Created reservations ['b8aa6b8e-a61f-4314-809c-9f8f26216a5d', '0d7782d6-0d97-4f65-af18-7db6b5dd9dde', '2627d93b-9e4d-44de-8c67-bcb8445f3aea', 'ea569f55-8d68-48f7-aba1-20d0c3af9a84'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:14:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-76bebe14-1611-475a-b7ac-2e751d94d875 tempest-SnapshotDependencyTests-341945119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:14:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-76bebe14-1611-475a-b7ac-2e751d94d875 tempest-SnapshotDependencyTests-341945119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:14:32 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-76bebe14-1611-475a-b7ac-2e751d94d875 tempest-SnapshotDependencyTests-341945119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:14:32 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-76bebe14-1611-475a-b7ac-2e751d94d875 tempest-SnapshotDependencyTests-341945119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:14:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-76bebe14-1611-475a-b7ac-2e751d94d875 tempest-SnapshotDependencyTests-341945119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:14:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-76bebe14-1611-475a-b7ac-2e751d94d875 tempest-SnapshotDependencyTests-341945119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:32 devstack sudo[100641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:14:32 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:32 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2d9d0eb5-9930-4943-800b-f1678efd420a" returned: 0 in 0.435s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:32 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:14:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:14:32 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a74f778b-aaeb-42b3-bfab-768321d93245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d9d0eb5-9930-4943-800b-f1678efd420a', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:32 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4254e45d-e054-42cf-a38c-029fd84efc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:32 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Volume volume-2d9d0eb5-9930-4943-800b-f1678efd420a (2d9d0eb5-9930-4943-800b-f1678efd420a): created successfully
Nov 19 13:14:32 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4254e45d-e054-42cf-a38c-029fd84efc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:32 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Flow 'volume_create_manager' (c8fb795d-6793-400b-a610-4fe3d39f2fa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:14:32 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-208004f4-72dd-4e19-8143-9332dc4236f9 tempest-GroupsTest-1103387332 None] Created volume successfully.
Nov 19 13:14:32 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-76bebe14-1611-475a-b7ac-2e751d94d875 tempest-SnapshotDependencyTests-341945119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.427s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:32 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-76bebe14-1611-475a-b7ac-2e751d94d875 tempest-SnapshotDependencyTests-341945119 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:14:32 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-76bebe14-1611-475a-b7ac-2e751d94d875 tempest-SnapshotDependencyTests-341945119 None] Deleted volume successfully.
Nov 19 13:14:32 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-76bebe14-1611-475a-b7ac-2e751d94d875 tempest-SnapshotDependencyTests-341945119 None] Lock "cinder-2870f6df-4efd-4fa3-8877-735d1f09127f-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:14:33 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:14:33 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Flow 'volume_create_manager' (f17bd0bf-1d5a-4aad-942d-86fb487d6901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:14:33 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499e46e5-d691-4456-b02b-2880cc325c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:33 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499e46e5-d691-4456-b02b-2880cc325c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1412836184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=387807ee-79bb-4eb7-9859-e111c9a0e56b,host='devstack@QuobyteHD#QuobyteHD',id=d37aa838-ac5d-40f7-a2fb-7a12d860d6ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09680b87bc194eb9a7440b417442d7f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:14:33Z,use_quota=True,user_id='4923d22c426949aa9223c6d98c9bf4c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c33ae6a-e9e2-42ef-888e-ee456f39afff),volume_type_id=1c33ae6a-e9e2-42ef-888e-ee456f39afff)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:33 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7412d255-3410-403b-8dc1-70e041a7f33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:33 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7412d255-3410-403b-8dc1-70e041a7f33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:33 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b263f5-e3d7-4bb6-8762-25c5707e5def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:33 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b263f5-e3d7-4bb6-8762-25c5707e5def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd37aa838-ac5d-40f7-a2fb-7a12d860d6ac', 'volume_name': 'volume-d37aa838-ac5d-40f7-a2fb-7a12d860d6ac', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:33 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528c3660-2281-435e-85e2-16795f73083f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:33 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528c3660-2281-435e-85e2-16795f73083f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:33 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b3d0ec-c12a-484f-be38-85f205e206c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:33 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Volume d37aa838-ac5d-40f7-a2fb-7a12d860d6ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d37aa838-ac5d-40f7-a2fb-7a12d860d6ac', 'volume_size': 1}
Nov 19 13:14:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:14:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:14:33 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=387807ee-79bb-4eb7-9859-e111c9a0e56b,created_at=2025-11-19T12:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1412836184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=387807ee-79bb-4eb7-9859-e111c9a0e56b,host='devstack@QuobyteHD#QuobyteHD',id=d37aa838-ac5d-40f7-a2fb-7a12d860d6ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09680b87bc194eb9a7440b417442d7f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:14:33Z,use_quota=True,user_id='4923d22c426949aa9223c6d98c9bf4c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c33ae6a-e9e2-42ef-888e-ee456f39afff),volume_type_id=1c33ae6a-e9e2-42ef-888e-ee456f39afff)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:14:33 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Creating volume d37aa838-ac5d-40f7-a2fb-7a12d860d6ac {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:14:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:14:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:14:33 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:14:33 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:14:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:14:33 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:14:33 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:14:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d37aa838-ac5d-40f7-a2fb-7a12d860d6ac 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:33 devstack sudo[100646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d37aa838-ac5d-40f7-a2fb-7a12d860d6ac 1073741824
Nov 19 13:14:33 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:34 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d37aa838-ac5d-40f7-a2fb-7a12d860d6ac 1073741824" returned: 0 in 0.586s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d37aa838-ac5d-40f7-a2fb-7a12d860d6ac {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:34 devstack sudo[100652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d37aa838-ac5d-40f7-a2fb-7a12d860d6ac
Nov 19 13:14:34 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:34 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d37aa838-ac5d-40f7-a2fb-7a12d860d6ac" returned: 0 in 0.484s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:34 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:14:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:14:34 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b3d0ec-c12a-484f-be38-85f205e206c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d37aa838-ac5d-40f7-a2fb-7a12d860d6ac', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:34 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322c116d-2e43-42ce-9250-88abae364fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:34 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Volume volume-d37aa838-ac5d-40f7-a2fb-7a12d860d6ac (d37aa838-ac5d-40f7-a2fb-7a12d860d6ac): created successfully
Nov 19 13:14:34 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322c116d-2e43-42ce-9250-88abae364fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:34 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Flow 'volume_create_manager' (f17bd0bf-1d5a-4aad-942d-86fb487d6901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:14:34 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-839c8993-9b2f-4d0d-a6c1-b97200b9ab59 tempest-GroupsTest-1103387332 None] Created volume successfully.
Nov 19 13:14:35 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-751ba131-a786-44a4-848a-c7343e6324a5 tempest-GroupsTest-1103387332 None] Update group completed successfully.
Nov 19 13:14:37 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-7ab02335-b7e7-4316-8187-95120be45ea3 tempest-GroupsTest-1103387332 None] Update group completed successfully.
Nov 19 13:14:38 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] Acquiring lock "cinder-quobyte-2d9d0eb5-9930-4943-800b-f1678efd420a" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:14:38 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] Lock "cinder-quobyte-2d9d0eb5-9930-4943-800b-f1678efd420a" acquired by "delete_volume" :: waited 0.015s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:14:38 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d53cac-3a20-43ce-9c24-caa7eaf0f492]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:14:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2d9d0eb5-9930-4943-800b-f1678efd420a {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:38 devstack sudo[100698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2d9d0eb5-9930-4943-800b-f1678efd420a
Nov 19 13:14:38 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:38 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2d9d0eb5-9930-4943-800b-f1678efd420a" returned: 0 in 0.588s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2d9d0eb5-9930-4943-800b-f1678efd420a {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:38 devstack sudo[100703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2d9d0eb5-9930-4943-800b-f1678efd420a
Nov 19 13:14:38 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:39 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2d9d0eb5-9930-4943-800b-f1678efd420a" returned: 0 in 0.477s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:39 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] Lock "cinder-quobyte-2d9d0eb5-9930-4943-800b-f1678efd420a" released by "delete_volume" :: held 1.106s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:14:39 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] Acquiring lock "cinder-quobyte-d37aa838-ac5d-40f7-a2fb-7a12d860d6ac" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:14:39 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] Lock "cinder-quobyte-d37aa838-ac5d-40f7-a2fb-7a12d860d6ac" acquired by "delete_volume" :: waited 0.012s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:14:39 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[25588d32-c8a3-4137-9019-3a1b62cca5f8]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:14:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d37aa838-ac5d-40f7-a2fb-7a12d860d6ac {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:39 devstack sudo[100706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d37aa838-ac5d-40f7-a2fb-7a12d860d6ac
Nov 19 13:14:39 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:39 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d37aa838-ac5d-40f7-a2fb-7a12d860d6ac" returned: 0 in 0.539s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d37aa838-ac5d-40f7-a2fb-7a12d860d6ac {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:39 devstack sudo[100712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d37aa838-ac5d-40f7-a2fb-7a12d860d6ac
Nov 19 13:14:39 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:40 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d37aa838-ac5d-40f7-a2fb-7a12d860d6ac" returned: 0 in 0.424s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:40 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] Lock "cinder-quobyte-d37aa838-ac5d-40f7-a2fb-7a12d860d6ac" released by "delete_volume" :: held 0.985s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:14:40 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] Created reservations ['049283b6-3f10-41a8-bc6d-f8e56af947c1'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:14:40 devstack cinder-volume[80839]: WARNING cinder.quota [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-272834705 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-272834705, it is now deprecated. Please use the default quota class for default quota.
Nov 19 13:14:40 devstack cinder-volume[80839]: WARNING cinder.quota [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-272834705 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-272834705, it is now deprecated. Please use the default quota class for default quota.
Nov 19 13:14:40 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] Created reservations ['841c1f6d-19c2-4640-82d4-6eabbff2bd96', 'd84f0df2-3dab-4a9c-b017-acac541c42ea', '77d0402c-1a2d-4e15-aa05-95cc26d11e57', 'a500c559-e4f4-4c2e-be29-823f619ed425'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:14:40 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] Created reservations ['5d5bd59d-6835-4e39-8d40-42aaf51c79db', 'ce146cac-bf92-4e2f-806c-7c84eb4a6539', '12f31e20-23b2-4a02-bd99-766ded9beeb3', '7beac201-756a-4253-bcbd-c474cf43dfdd'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:14:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:14:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:14:40 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:14:40 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:14:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:14:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:40 devstack sudo[100715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:14:40 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:41 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.447s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:41 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:14:41 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-f3897bb7-e58b-4377-93a3-03ec48c9fc3d tempest-GroupsTest-1103387332 None] Delete group completed successfully.
Nov 19 13:14:45 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:14:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Flow 'volume_create_manager' (f60d5fcf-687e-4218-bb2b-fe6092010472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:14:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14207805-f402-41d4-a360-3ec071824fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14207805-f402-41d4-a360-3ec071824fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-506728736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86c17811-b8a1-4908-bc48-6bdebdf86c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='462d37c0c4ba42209ccb82b0c5a864c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:14:45Z,use_quota=True,user_id='9c519bfd6a35471abb7880dfc89c78d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb62ff9a-83a7-4428-8338-8aaef4218539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb62ff9a-83a7-4428-8338-8aaef4218539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77bbeeb1-4ac9-456a-a52f-f261cf1acf14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77bbeeb1-4ac9-456a-a52f-f261cf1acf14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86c17811-b8a1-4908-bc48-6bdebdf86c00', 'volume_name': 'volume-86c17811-b8a1-4908-bc48-6bdebdf86c00', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c2487e8-54b0-4721-b771-0f5bd9cae58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c2487e8-54b0-4721-b771-0f5bd9cae58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb28c52-1d2c-4a30-98d9-bfa80f972630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:45 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Volume 86c17811-b8a1-4908-bc48-6bdebdf86c00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86c17811-b8a1-4908-bc48-6bdebdf86c00', 'volume_size': 1}
Nov 19 13:14:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:14:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:14:45 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-506728736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86c17811-b8a1-4908-bc48-6bdebdf86c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='462d37c0c4ba42209ccb82b0c5a864c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:14:45Z,use_quota=True,user_id='9c519bfd6a35471abb7880dfc89c78d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:14:45 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Creating volume 86c17811-b8a1-4908-bc48-6bdebdf86c00 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:14:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:14:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:14:45 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:14:45 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:14:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:14:45 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:14:45 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:14:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-86c17811-b8a1-4908-bc48-6bdebdf86c00 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:45 devstack sudo[100720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-86c17811-b8a1-4908-bc48-6bdebdf86c00 1073741824
Nov 19 13:14:45 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:45 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-86c17811-b8a1-4908-bc48-6bdebdf86c00 1073741824" returned: 0 in 0.525s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-86c17811-b8a1-4908-bc48-6bdebdf86c00 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:45 devstack sudo[100725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-86c17811-b8a1-4908-bc48-6bdebdf86c00
Nov 19 13:14:45 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:46 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-86c17811-b8a1-4908-bc48-6bdebdf86c00" returned: 0 in 0.420s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:46 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:14:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:14:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb28c52-1d2c-4a30-98d9-bfa80f972630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86c17811-b8a1-4908-bc48-6bdebdf86c00', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d924bb-f907-43d5-9b61-f09f7f4256da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:46 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Volume volume-86c17811-b8a1-4908-bc48-6bdebdf86c00 (86c17811-b8a1-4908-bc48-6bdebdf86c00): created successfully
Nov 19 13:14:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d924bb-f907-43d5-9b61-f09f7f4256da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Flow 'volume_create_manager' (f60d5fcf-687e-4218-bb2b-fe6092010472) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:14:46 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-65359b9a-7251-4fed-812a-02ad5e614c40 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Created volume successfully.
Nov 19 13:14:47 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-61b5ba2e-cf9e-4cf1-b2f4-e761238ec936 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Acquiring lock "cinder-86c17811-b8a1-4908-bc48-6bdebdf86c00-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:14:47 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-61b5ba2e-cf9e-4cf1-b2f4-e761238ec936 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Lock "cinder-86c17811-b8a1-4908-bc48-6bdebdf86c00-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:14:47 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-61b5ba2e-cf9e-4cf1-b2f4-e761238ec936 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Acquiring lock "cinder-quobyte-86c17811-b8a1-4908-bc48-6bdebdf86c00" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:14:47 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-61b5ba2e-cf9e-4cf1-b2f4-e761238ec936 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Lock "cinder-quobyte-86c17811-b8a1-4908-bc48-6bdebdf86c00" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:14:47 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[784e0a11-cfc5-410a-8a5e-0145e043f8c3]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:14:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-61b5ba2e-cf9e-4cf1-b2f4-e761238ec936 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-86c17811-b8a1-4908-bc48-6bdebdf86c00 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:47 devstack sudo[100728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-86c17811-b8a1-4908-bc48-6bdebdf86c00
Nov 19 13:14:47 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:47 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-61b5ba2e-cf9e-4cf1-b2f4-e761238ec936 tempest-VolumeQuotasAdminTestJSON-1154871609 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-86c17811-b8a1-4908-bc48-6bdebdf86c00" returned: 0 in 0.520s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-61b5ba2e-cf9e-4cf1-b2f4-e761238ec936 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-86c17811-b8a1-4908-bc48-6bdebdf86c00 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:47 devstack sudo[100733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-86c17811-b8a1-4908-bc48-6bdebdf86c00
Nov 19 13:14:47 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:48 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-61b5ba2e-cf9e-4cf1-b2f4-e761238ec936 tempest-VolumeQuotasAdminTestJSON-1154871609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-86c17811-b8a1-4908-bc48-6bdebdf86c00" returned: 0 in 0.416s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-61b5ba2e-cf9e-4cf1-b2f4-e761238ec936 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Lock "cinder-quobyte-86c17811-b8a1-4908-bc48-6bdebdf86c00" released by "delete_volume" :: held 0.965s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-61b5ba2e-cf9e-4cf1-b2f4-e761238ec936 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Created reservations ['e4e90450-8ea8-4e3c-8232-0707cce7be4b', 'e5ad6e31-64d1-488b-b6a2-f49f10aedf01', 'accb40ce-d516-4d39-8b0a-751569a0aa31', '2b91f2d0-6483-42cd-97f8-aa6a179f0ae6'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-61b5ba2e-cf9e-4cf1-b2f4-e761238ec936 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-61b5ba2e-cf9e-4cf1-b2f4-e761238ec936 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-61b5ba2e-cf9e-4cf1-b2f4-e761238ec936 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-61b5ba2e-cf9e-4cf1-b2f4-e761238ec936 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-61b5ba2e-cf9e-4cf1-b2f4-e761238ec936 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-61b5ba2e-cf9e-4cf1-b2f4-e761238ec936 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:48 devstack sudo[100736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:14:48 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Flow 'volume_create_manager' (11fff958-70d1-4a0e-bb3d-8f6a0539797c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8de82ed-1d24-4233-8b96-7c5e8ad7fb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8de82ed-1d24-4233-8b96-7c5e8ad7fb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-30580124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f5028c-c81d-4f2b-a7a3-0984a94acf8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='462d37c0c4ba42209ccb82b0c5a864c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:14:49Z,use_quota=True,user_id='9c519bfd6a35471abb7880dfc89c78d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef0c212-bfd9-4eba-8ce6-9d3a8b6cf4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef0c212-bfd9-4eba-8ce6-9d3a8b6cf4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92eaf06e-2a6a-4872-aeb2-12b505a47258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92eaf06e-2a6a-4872-aeb2-12b505a47258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12f5028c-c81d-4f2b-a7a3-0984a94acf8c', 'volume_name': 'volume-12f5028c-c81d-4f2b-a7a3-0984a94acf8c', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b6696f0-6593-4a80-b484-1c0942d8a5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b6696f0-6593-4a80-b484-1c0942d8a5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd89cf4-3c4f-493b-8dfc-a035397d890b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:48 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Volume 12f5028c-c81d-4f2b-a7a3-0984a94acf8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12f5028c-c81d-4f2b-a7a3-0984a94acf8c', 'volume_size': 1}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-30580124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f5028c-c81d-4f2b-a7a3-0984a94acf8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='462d37c0c4ba42209ccb82b0c5a864c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:14:49Z,use_quota=True,user_id='9c519bfd6a35471abb7880dfc89c78d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Creating volume 12f5028c-c81d-4f2b-a7a3-0984a94acf8c {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:14:48 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-12f5028c-c81d-4f2b-a7a3-0984a94acf8c 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:48 devstack sudo[100738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-12f5028c-c81d-4f2b-a7a3-0984a94acf8c 1073741824
Nov 19 13:14:48 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:48 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-61b5ba2e-cf9e-4cf1-b2f4-e761238ec936 tempest-VolumeQuotasAdminTestJSON-1154871609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.489s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-61b5ba2e-cf9e-4cf1-b2f4-e761238ec936 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:14:48 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-61b5ba2e-cf9e-4cf1-b2f4-e761238ec936 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Deleted volume successfully.
Nov 19 13:14:48 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-61b5ba2e-cf9e-4cf1-b2f4-e761238ec936 tempest-VolumeQuotasAdminTestJSON-1154871609 None] Lock "cinder-86c17811-b8a1-4908-bc48-6bdebdf86c00-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:14:49 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-12f5028c-c81d-4f2b-a7a3-0984a94acf8c 1073741824" returned: 0 in 0.523s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-12f5028c-c81d-4f2b-a7a3-0984a94acf8c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:49 devstack sudo[100744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-12f5028c-c81d-4f2b-a7a3-0984a94acf8c
Nov 19 13:14:49 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:49 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-12f5028c-c81d-4f2b-a7a3-0984a94acf8c" returned: 0 in 0.415s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:49 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:14:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:14:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd89cf4-3c4f-493b-8dfc-a035397d890b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12f5028c-c81d-4f2b-a7a3-0984a94acf8c', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1515041a-c8dc-48c7-9c2f-1fe45ea5dd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:14:49 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Volume volume-12f5028c-c81d-4f2b-a7a3-0984a94acf8c (12f5028c-c81d-4f2b-a7a3-0984a94acf8c): created successfully
Nov 19 13:14:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1515041a-c8dc-48c7-9c2f-1fe45ea5dd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:14:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Flow 'volume_create_manager' (11fff958-70d1-4a0e-bb3d-8f6a0539797c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:14:49 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-be6c8be8-2745-4bf7-833d-c26d8f7351db tempest-VolumeQuotasAdminTestJSON-1154871609 None] Created volume successfully.
Nov 19 13:14:51 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-565e4e5d-9af7-40d7-a6f5-3d99ce991bdc tempest-VolumeQuotasAdminTestJSON-1473146473 None] Transfer volume completed successfully.
Nov 19 13:14:51 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-52e22ca2-a077-4373-9ab2-60294f57c213 tempest-VolumeQuotasAdminTestJSON-387918875 None] Acquiring lock "cinder-12f5028c-c81d-4f2b-a7a3-0984a94acf8c-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:14:51 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-52e22ca2-a077-4373-9ab2-60294f57c213 tempest-VolumeQuotasAdminTestJSON-387918875 None] Lock "cinder-12f5028c-c81d-4f2b-a7a3-0984a94acf8c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:14:51 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-52e22ca2-a077-4373-9ab2-60294f57c213 tempest-VolumeQuotasAdminTestJSON-387918875 None] Acquiring lock "cinder-quobyte-12f5028c-c81d-4f2b-a7a3-0984a94acf8c" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:14:51 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-52e22ca2-a077-4373-9ab2-60294f57c213 tempest-VolumeQuotasAdminTestJSON-387918875 None] Lock "cinder-quobyte-12f5028c-c81d-4f2b-a7a3-0984a94acf8c" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:14:51 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10e17f4-119c-47c1-bb98-e35cf05c2ad9]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:14:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-52e22ca2-a077-4373-9ab2-60294f57c213 tempest-VolumeQuotasAdminTestJSON-387918875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-12f5028c-c81d-4f2b-a7a3-0984a94acf8c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:51 devstack sudo[100748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-12f5028c-c81d-4f2b-a7a3-0984a94acf8c
Nov 19 13:14:51 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:52 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-52e22ca2-a077-4373-9ab2-60294f57c213 tempest-VolumeQuotasAdminTestJSON-387918875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-12f5028c-c81d-4f2b-a7a3-0984a94acf8c" returned: 0 in 0.507s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-52e22ca2-a077-4373-9ab2-60294f57c213 tempest-VolumeQuotasAdminTestJSON-387918875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-12f5028c-c81d-4f2b-a7a3-0984a94acf8c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:52 devstack sudo[100753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-12f5028c-c81d-4f2b-a7a3-0984a94acf8c
Nov 19 13:14:52 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:52 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-52e22ca2-a077-4373-9ab2-60294f57c213 tempest-VolumeQuotasAdminTestJSON-387918875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-12f5028c-c81d-4f2b-a7a3-0984a94acf8c" returned: 0 in 0.422s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:52 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-52e22ca2-a077-4373-9ab2-60294f57c213 tempest-VolumeQuotasAdminTestJSON-387918875 None] Lock "cinder-quobyte-12f5028c-c81d-4f2b-a7a3-0984a94acf8c" released by "delete_volume" :: held 0.952s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:14:52 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-52e22ca2-a077-4373-9ab2-60294f57c213 tempest-VolumeQuotasAdminTestJSON-387918875 None] Created reservations ['e7165d38-83fb-4dfa-a588-ef8d4ac476af', '47f3f032-8ac9-489f-a269-6d811d27259f', '692cfb42-f643-4135-b423-87a5ab40ba13', '516d43fa-def9-4b3a-be78-5755adda2e37'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:14:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-52e22ca2-a077-4373-9ab2-60294f57c213 tempest-VolumeQuotasAdminTestJSON-387918875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:14:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-52e22ca2-a077-4373-9ab2-60294f57c213 tempest-VolumeQuotasAdminTestJSON-387918875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:14:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-52e22ca2-a077-4373-9ab2-60294f57c213 tempest-VolumeQuotasAdminTestJSON-387918875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:14:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-52e22ca2-a077-4373-9ab2-60294f57c213 tempest-VolumeQuotasAdminTestJSON-387918875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:14:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-52e22ca2-a077-4373-9ab2-60294f57c213 tempest-VolumeQuotasAdminTestJSON-387918875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:14:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-52e22ca2-a077-4373-9ab2-60294f57c213 tempest-VolumeQuotasAdminTestJSON-387918875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:14:52 devstack sudo[100761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:14:52 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:14:53 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root
Nov 19 13:14:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-52e22ca2-a077-4373-9ab2-60294f57c213 tempest-VolumeQuotasAdminTestJSON-387918875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.477s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:14:53 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-52e22ca2-a077-4373-9ab2-60294f57c213 tempest-VolumeQuotasAdminTestJSON-387918875 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:14:53 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-52e22ca2-a077-4373-9ab2-60294f57c213 tempest-VolumeQuotasAdminTestJSON-387918875 None] Deleted volume successfully.
Nov 19 13:14:53 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-52e22ca2-a077-4373-9ab2-60294f57c213 tempest-VolumeQuotasAdminTestJSON-387918875 None] Lock "cinder-12f5028c-c81d-4f2b-a7a3-0984a94acf8c-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:01 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:15:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Flow 'volume_create_manager' (fbacfeb5-c46a-445a-b7e5-2ba974ab09de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:15:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f59a23a-c033-4b36-b089-45e6412a8e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f59a23a-c033-4b36-b089-45e6412a8e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-706522924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=898a83af-94ce-49db-8ba6-e18d7f3869cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c3cdf6bc3044c294a12f94e9c59f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:15:02Z,use_quota=True,user_id='faa50a8996444d62a7806661e8121221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9bdfed-23d2-4cf7-a2aa-a6b7ebc6b4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9bdfed-23d2-4cf7-a2aa-a6b7ebc6b4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b546ae-819c-4c5e-8aa6-1908666a89e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b546ae-819c-4c5e-8aa6-1908666a89e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '898a83af-94ce-49db-8ba6-e18d7f3869cd', 'volume_name': 'volume-898a83af-94ce-49db-8ba6-e18d7f3869cd', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29510169-fde2-4355-bc52-0e7861f6adce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29510169-fde2-4355-bc52-0e7861f6adce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a7b56f-ba1e-4c53-9bda-e3e67abf8723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:01 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Volume 898a83af-94ce-49db-8ba6-e18d7f3869cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-898a83af-94ce-49db-8ba6-e18d7f3869cd', 'volume_size': 1}
Nov 19 13:15:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-706522924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=898a83af-94ce-49db-8ba6-e18d7f3869cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c3cdf6bc3044c294a12f94e9c59f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:15:02Z,use_quota=True,user_id='faa50a8996444d62a7806661e8121221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:15:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Creating volume 898a83af-94ce-49db-8ba6-e18d7f3869cd {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:15:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:15:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:15:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:15:01 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:15:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-898a83af-94ce-49db-8ba6-e18d7f3869cd 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:01 devstack sudo[100764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-898a83af-94ce-49db-8ba6-e18d7f3869cd 1073741824
Nov 19 13:15:01 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:02 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-898a83af-94ce-49db-8ba6-e18d7f3869cd 1073741824" returned: 0 in 0.529s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-898a83af-94ce-49db-8ba6-e18d7f3869cd {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:02 devstack sudo[100769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-898a83af-94ce-49db-8ba6-e18d7f3869cd
Nov 19 13:15:02 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:02 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-898a83af-94ce-49db-8ba6-e18d7f3869cd" returned: 0 in 0.431s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:02 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:15:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:02 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a7b56f-ba1e-4c53-9bda-e3e67abf8723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-898a83af-94ce-49db-8ba6-e18d7f3869cd', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:02 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (689dcf63-c101-483a-9817-91127aa03076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:02 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Volume volume-898a83af-94ce-49db-8ba6-e18d7f3869cd (898a83af-94ce-49db-8ba6-e18d7f3869cd): created successfully
Nov 19 13:15:02 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (689dcf63-c101-483a-9817-91127aa03076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:02 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Flow 'volume_create_manager' (fbacfeb5-c46a-445a-b7e5-2ba974ab09de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:15:02 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-50d52ba4-09ba-40ee-bb86-ed96fcaacb85 tempest-VolumesListAdminTestJSON-416114152 None] Created volume successfully.
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Flow 'volume_create_manager' (7805601c-e163-4e48-8b5f-2977b7f8c403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b75b678-2d53-47eb-9987-51edb66e1a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b75b678-2d53-47eb-9987-51edb66e1a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-790510854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b824a65c-f249-4ee4-9054-04e5b04ca8a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c3cdf6bc3044c294a12f94e9c59f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:15:04Z,use_quota=True,user_id='faa50a8996444d62a7806661e8121221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da8efb4d-7f54-4a82-8cbd-9e4dd2e4edc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da8efb4d-7f54-4a82-8cbd-9e4dd2e4edc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7931e1-391e-4a2d-858a-84caad2787be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7931e1-391e-4a2d-858a-84caad2787be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b824a65c-f249-4ee4-9054-04e5b04ca8a5', 'volume_name': 'volume-b824a65c-f249-4ee4-9054-04e5b04ca8a5', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43982b50-de84-4471-b4c7-2ddc9e49e813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43982b50-de84-4471-b4c7-2ddc9e49e813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c22965f-7c15-4e28-9d0a-f5dbf5925950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:04 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Volume b824a65c-f249-4ee4-9054-04e5b04ca8a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b824a65c-f249-4ee4-9054-04e5b04ca8a5', 'volume_size': 1}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-790510854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b824a65c-f249-4ee4-9054-04e5b04ca8a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c3cdf6bc3044c294a12f94e9c59f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:15:04Z,use_quota=True,user_id='faa50a8996444d62a7806661e8121221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Creating volume b824a65c-f249-4ee4-9054-04e5b04ca8a5 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:15:04 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b824a65c-f249-4ee4-9054-04e5b04ca8a5 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:04 devstack sudo[100773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b824a65c-f249-4ee4-9054-04e5b04ca8a5 1073741824
Nov 19 13:15:04 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:04 devstack sudo[100775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:15:04 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:04 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b824a65c-f249-4ee4-9054-04e5b04ca8a5 1073741824" returned: 0 in 0.520s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b824a65c-f249-4ee4-9054-04e5b04ca8a5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:04 devstack sudo[100780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b824a65c-f249-4ee4-9054-04e5b04ca8a5
Nov 19 13:15:04 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:04 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.454s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:04 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:15:05 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b824a65c-f249-4ee4-9054-04e5b04ca8a5" returned: 0 in 0.434s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:05 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:15:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:05 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c22965f-7c15-4e28-9d0a-f5dbf5925950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b824a65c-f249-4ee4-9054-04e5b04ca8a5', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:05 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b617aa18-aaf5-46d9-894d-5511ae7ddece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:05 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Volume volume-b824a65c-f249-4ee4-9054-04e5b04ca8a5 (b824a65c-f249-4ee4-9054-04e5b04ca8a5): created successfully
Nov 19 13:15:05 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b617aa18-aaf5-46d9-894d-5511ae7ddece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:05 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Flow 'volume_create_manager' (7805601c-e163-4e48-8b5f-2977b7f8c403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:15:05 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=96,cinder:INSERT=28,cinder:UPDATE=136,cinder:DELETE=10 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:15:05 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-4ca68a00-59d2-4cac-a33e-66ff7f3335a1 tempest-VolumesListAdminTestJSON-416114152 None] Created volume successfully.
Nov 19 13:15:05 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:UPDATE=98,cinder:SELECT=82,cinder:INSERT=19,cinder:DELETE=7 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:15:06 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:15:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Flow 'volume_create_manager' (a5f68fb8-fd68-499f-806e-71471796c46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:15:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0524aa4d-4922-44a7-82ca-ea839c8abb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0524aa4d-4922-44a7-82ca-ea839c8abb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1895810494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c88f8d9b-2a24-445f-9924-b3f791413860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c3cdf6bc3044c294a12f94e9c59f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:15:07Z,use_quota=True,user_id='faa50a8996444d62a7806661e8121221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16413c86-e42d-48cf-b5f6-ce502e7ba0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16413c86-e42d-48cf-b5f6-ce502e7ba0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82180e57-b5a9-4e54-b8c2-ad377f88078b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82180e57-b5a9-4e54-b8c2-ad377f88078b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c88f8d9b-2a24-445f-9924-b3f791413860', 'volume_name': 'volume-c88f8d9b-2a24-445f-9924-b3f791413860', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c3f1fc6-eda3-4aaf-9015-b7fd2a692a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c3f1fc6-eda3-4aaf-9015-b7fd2a692a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72bf6867-ab78-4b16-a774-3a27d1709a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:06 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Volume c88f8d9b-2a24-445f-9924-b3f791413860: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c88f8d9b-2a24-445f-9924-b3f791413860', 'volume_size': 1}
Nov 19 13:15:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1895810494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c88f8d9b-2a24-445f-9924-b3f791413860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c3cdf6bc3044c294a12f94e9c59f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:15:07Z,use_quota=True,user_id='faa50a8996444d62a7806661e8121221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:15:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Creating volume c88f8d9b-2a24-445f-9924-b3f791413860 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:15:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:15:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:15:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:15:06 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:15:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c88f8d9b-2a24-445f-9924-b3f791413860 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:06 devstack sudo[100784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c88f8d9b-2a24-445f-9924-b3f791413860 1073741824
Nov 19 13:15:06 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:07 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c88f8d9b-2a24-445f-9924-b3f791413860 1073741824" returned: 0 in 0.492s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c88f8d9b-2a24-445f-9924-b3f791413860 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:07 devstack sudo[100789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c88f8d9b-2a24-445f-9924-b3f791413860
Nov 19 13:15:07 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:07 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c88f8d9b-2a24-445f-9924-b3f791413860" returned: 0 in 0.411s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:15:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72bf6867-ab78-4b16-a774-3a27d1709a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c88f8d9b-2a24-445f-9924-b3f791413860', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29ea260-5dc6-43c4-b012-1b7df6769a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:07 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Volume volume-c88f8d9b-2a24-445f-9924-b3f791413860 (c88f8d9b-2a24-445f-9924-b3f791413860): created successfully
Nov 19 13:15:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29ea260-5dc6-43c4-b012-1b7df6769a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Flow 'volume_create_manager' (a5f68fb8-fd68-499f-806e-71471796c46c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:15:07 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-aa64e501-d4c0-4912-9330-f603348b1dee tempest-VolumesListAdminTestJSON-416114152 None] Created volume successfully.
Nov 19 13:15:08 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:15:08 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Flow 'volume_create_manager' (c37f5a0f-b532-403a-b23c-be2c816a0c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:15:08 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92dc41d9-5606-431e-9ecf-64a860fe317f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92dc41d9-5606-431e-9ecf-64a860fe317f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0533c293-b0eb-42d8-9239-3b391cbe9308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d865466ef32649f19f010e977d87deff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:15:09Z,use_quota=True,user_id='613b42fbc1b6405088a47076110d6922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d9bb542-e98b-4eb1-a726-61ead3b9ccb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d9bb542-e98b-4eb1-a726-61ead3b9ccb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba3c150-aabb-4bd0-a704-ed0c43b38fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba3c150-aabb-4bd0-a704-ed0c43b38fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0533c293-b0eb-42d8-9239-3b391cbe9308', 'volume_name': 'volume-0533c293-b0eb-42d8-9239-3b391cbe9308', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8accf4e7-fe4c-4373-8caf-afdd982fc1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8accf4e7-fe4c-4373-8caf-afdd982fc1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03ef51d-6540-4237-a5d7-7953f4934c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:09 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Volume 0533c293-b0eb-42d8-9239-3b391cbe9308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0533c293-b0eb-42d8-9239-3b391cbe9308', 'volume_size': 1}
Nov 19 13:15:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:09 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0533c293-b0eb-42d8-9239-3b391cbe9308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d865466ef32649f19f010e977d87deff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:15:09Z,use_quota=True,user_id='613b42fbc1b6405088a47076110d6922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:15:09 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Creating volume 0533c293-b0eb-42d8-9239-3b391cbe9308 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:15:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:09 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:15:09 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:15:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:09 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:15:09 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:15:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0533c293-b0eb-42d8-9239-3b391cbe9308 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:09 devstack sudo[100792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0533c293-b0eb-42d8-9239-3b391cbe9308 1073741824
Nov 19 13:15:09 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:09 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0533c293-b0eb-42d8-9239-3b391cbe9308 1073741824" returned: 0 in 0.513s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0533c293-b0eb-42d8-9239-3b391cbe9308 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:09 devstack sudo[100797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0533c293-b0eb-42d8-9239-3b391cbe9308
Nov 19 13:15:09 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:09 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0533c293-b0eb-42d8-9239-3b391cbe9308" returned: 0 in 0.421s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:09 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:15:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03ef51d-6540-4237-a5d7-7953f4934c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0533c293-b0eb-42d8-9239-3b391cbe9308', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad9cc478-4189-4586-8503-a6507f08b898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:10 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Volume volume-0533c293-b0eb-42d8-9239-3b391cbe9308 (0533c293-b0eb-42d8-9239-3b391cbe9308): created successfully
Nov 19 13:15:10 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad9cc478-4189-4586-8503-a6507f08b898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:10 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Flow 'volume_create_manager' (c37f5a0f-b532-403a-b23c-be2c816a0c5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:15:10 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-d5aa0e85-605c-4e48-a5f7-cc954edd9ed4 tempest-VolumesListAdminTestJSON-1225169796 None] Created volume successfully.
Nov 19 13:15:11 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-aabd73f3-122d-4ff0-8106-eff4af5d8e26 tempest-VolumesListAdminTestJSON-1225169796 None] Acquiring lock "cinder-0533c293-b0eb-42d8-9239-3b391cbe9308-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:11 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-aabd73f3-122d-4ff0-8106-eff4af5d8e26 tempest-VolumesListAdminTestJSON-1225169796 None] Lock "cinder-0533c293-b0eb-42d8-9239-3b391cbe9308-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:11 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-aabd73f3-122d-4ff0-8106-eff4af5d8e26 tempest-VolumesListAdminTestJSON-1225169796 None] Acquiring lock "cinder-quobyte-0533c293-b0eb-42d8-9239-3b391cbe9308" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:11 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-aabd73f3-122d-4ff0-8106-eff4af5d8e26 tempest-VolumesListAdminTestJSON-1225169796 None] Lock "cinder-quobyte-0533c293-b0eb-42d8-9239-3b391cbe9308" acquired by "delete_volume" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:11 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fc7a43-6915-44b6-8b2c-56f98d1b017b]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:15:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-aabd73f3-122d-4ff0-8106-eff4af5d8e26 tempest-VolumesListAdminTestJSON-1225169796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0533c293-b0eb-42d8-9239-3b391cbe9308 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:11 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-2abfee61-705f-4360-9eb8-311e6319470e tempest-VolumesListAdminTestJSON-416114152 None] Acquiring lock "cinder-c88f8d9b-2a24-445f-9924-b3f791413860-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:11 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-2abfee61-705f-4360-9eb8-311e6319470e tempest-VolumesListAdminTestJSON-416114152 None] Lock "cinder-c88f8d9b-2a24-445f-9924-b3f791413860-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:11 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-2abfee61-705f-4360-9eb8-311e6319470e tempest-VolumesListAdminTestJSON-416114152 None] Acquiring lock "cinder-quobyte-c88f8d9b-2a24-445f-9924-b3f791413860" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:11 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-2abfee61-705f-4360-9eb8-311e6319470e tempest-VolumesListAdminTestJSON-416114152 None] Lock "cinder-quobyte-c88f8d9b-2a24-445f-9924-b3f791413860" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:11 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fbaf91-6eb0-4d11-aeaf-29da3c2a2e1a]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:15:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2abfee61-705f-4360-9eb8-311e6319470e tempest-VolumesListAdminTestJSON-416114152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c88f8d9b-2a24-445f-9924-b3f791413860 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:11 devstack sudo[100800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0533c293-b0eb-42d8-9239-3b391cbe9308
Nov 19 13:15:11 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:11 devstack sudo[100801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c88f8d9b-2a24-445f-9924-b3f791413860
Nov 19 13:15:11 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:11 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-aabd73f3-122d-4ff0-8106-eff4af5d8e26 tempest-VolumesListAdminTestJSON-1225169796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0533c293-b0eb-42d8-9239-3b391cbe9308" returned: 0 in 0.532s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-aabd73f3-122d-4ff0-8106-eff4af5d8e26 tempest-VolumesListAdminTestJSON-1225169796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0533c293-b0eb-42d8-9239-3b391cbe9308 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:11 devstack sudo[100807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0533c293-b0eb-42d8-9239-3b391cbe9308
Nov 19 13:15:11 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:11 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2abfee61-705f-4360-9eb8-311e6319470e tempest-VolumesListAdminTestJSON-416114152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c88f8d9b-2a24-445f-9924-b3f791413860" returned: 0 in 0.559s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2abfee61-705f-4360-9eb8-311e6319470e tempest-VolumesListAdminTestJSON-416114152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c88f8d9b-2a24-445f-9924-b3f791413860 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:11 devstack sudo[100812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c88f8d9b-2a24-445f-9924-b3f791413860
Nov 19 13:15:11 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:12 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-aabd73f3-122d-4ff0-8106-eff4af5d8e26 tempest-VolumesListAdminTestJSON-1225169796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0533c293-b0eb-42d8-9239-3b391cbe9308" returned: 0 in 0.437s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-aabd73f3-122d-4ff0-8106-eff4af5d8e26 tempest-VolumesListAdminTestJSON-1225169796 None] Lock "cinder-quobyte-0533c293-b0eb-42d8-9239-3b391cbe9308" released by "delete_volume" :: held 0.989s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:12 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-aabd73f3-122d-4ff0-8106-eff4af5d8e26 tempest-VolumesListAdminTestJSON-1225169796 None] Created reservations ['c04a4fc5-d4fb-4a12-a0fb-7054e4417dae', '7a0a82f5-d343-4c40-bcba-9a0fb3efc5f8', 'a152435e-39a5-4be5-9089-32d4094ee0e0', 'fb61c9a7-fdf8-45ee-a6aa-7ce79a5d22c7'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:15:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-aabd73f3-122d-4ff0-8106-eff4af5d8e26 tempest-VolumesListAdminTestJSON-1225169796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-aabd73f3-122d-4ff0-8106-eff4af5d8e26 tempest-VolumesListAdminTestJSON-1225169796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-aabd73f3-122d-4ff0-8106-eff4af5d8e26 tempest-VolumesListAdminTestJSON-1225169796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:15:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-aabd73f3-122d-4ff0-8106-eff4af5d8e26 tempest-VolumesListAdminTestJSON-1225169796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:15:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-aabd73f3-122d-4ff0-8106-eff4af5d8e26 tempest-VolumesListAdminTestJSON-1225169796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-aabd73f3-122d-4ff0-8106-eff4af5d8e26 tempest-VolumesListAdminTestJSON-1225169796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:12 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2abfee61-705f-4360-9eb8-311e6319470e tempest-VolumesListAdminTestJSON-416114152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c88f8d9b-2a24-445f-9924-b3f791413860" returned: 0 in 0.428s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:12 devstack sudo[100816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:15:12 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-2abfee61-705f-4360-9eb8-311e6319470e tempest-VolumesListAdminTestJSON-416114152 None] Lock "cinder-quobyte-c88f8d9b-2a24-445f-9924-b3f791413860" released by "delete_volume" :: held 1.007s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:12 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-2abfee61-705f-4360-9eb8-311e6319470e tempest-VolumesListAdminTestJSON-416114152 None] Created reservations ['6858e0c1-be40-4837-8b98-67f50fa064d1', 'a49c2ae8-f7ab-443a-9b2a-3fb87af7f4c0', '3873998b-f66b-4b71-ae75-54f626481bd8', '1c38b0b2-29a4-4bcd-9455-b1f3ef721431'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:15:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2abfee61-705f-4360-9eb8-311e6319470e tempest-VolumesListAdminTestJSON-416114152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2abfee61-705f-4360-9eb8-311e6319470e tempest-VolumesListAdminTestJSON-416114152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-2abfee61-705f-4360-9eb8-311e6319470e tempest-VolumesListAdminTestJSON-416114152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:15:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-2abfee61-705f-4360-9eb8-311e6319470e tempest-VolumesListAdminTestJSON-416114152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:15:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2abfee61-705f-4360-9eb8-311e6319470e tempest-VolumesListAdminTestJSON-416114152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2abfee61-705f-4360-9eb8-311e6319470e tempest-VolumesListAdminTestJSON-416114152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:12 devstack sudo[100818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:15:12 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:12 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-aabd73f3-122d-4ff0-8106-eff4af5d8e26 tempest-VolumesListAdminTestJSON-1225169796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.437s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:12 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-aabd73f3-122d-4ff0-8106-eff4af5d8e26 tempest-VolumesListAdminTestJSON-1225169796 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:15:12 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-aabd73f3-122d-4ff0-8106-eff4af5d8e26 tempest-VolumesListAdminTestJSON-1225169796 None] Deleted volume successfully.
Nov 19 13:15:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-aabd73f3-122d-4ff0-8106-eff4af5d8e26 tempest-VolumesListAdminTestJSON-1225169796 None] Lock "cinder-0533c293-b0eb-42d8-9239-3b391cbe9308-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:12 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2abfee61-705f-4360-9eb8-311e6319470e tempest-VolumesListAdminTestJSON-416114152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.433s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:12 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-2abfee61-705f-4360-9eb8-311e6319470e tempest-VolumesListAdminTestJSON-416114152 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:15:12 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-2abfee61-705f-4360-9eb8-311e6319470e tempest-VolumesListAdminTestJSON-416114152 None] Deleted volume successfully.
Nov 19 13:15:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-2abfee61-705f-4360-9eb8-311e6319470e tempest-VolumesListAdminTestJSON-416114152 None] Lock "cinder-c88f8d9b-2a24-445f-9924-b3f791413860-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:13 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-cbc7bfbf-8be3-48f3-a938-f091bb9a5e69 tempest-VolumesListAdminTestJSON-416114152 None] Acquiring lock "cinder-b824a65c-f249-4ee4-9054-04e5b04ca8a5-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:13 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-cbc7bfbf-8be3-48f3-a938-f091bb9a5e69 tempest-VolumesListAdminTestJSON-416114152 None] Lock "cinder-b824a65c-f249-4ee4-9054-04e5b04ca8a5-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:13 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-cbc7bfbf-8be3-48f3-a938-f091bb9a5e69 tempest-VolumesListAdminTestJSON-416114152 None] Acquiring lock "cinder-quobyte-b824a65c-f249-4ee4-9054-04e5b04ca8a5" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:13 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-cbc7bfbf-8be3-48f3-a938-f091bb9a5e69 tempest-VolumesListAdminTestJSON-416114152 None] Lock "cinder-quobyte-b824a65c-f249-4ee4-9054-04e5b04ca8a5" acquired by "delete_volume" :: waited 0.006s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:13 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[575d30c9-a79c-49be-8e45-ad9559949c48]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:15:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cbc7bfbf-8be3-48f3-a938-f091bb9a5e69 tempest-VolumesListAdminTestJSON-416114152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b824a65c-f249-4ee4-9054-04e5b04ca8a5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:13 devstack sudo[100823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b824a65c-f249-4ee4-9054-04e5b04ca8a5
Nov 19 13:15:13 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:14 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cbc7bfbf-8be3-48f3-a938-f091bb9a5e69 tempest-VolumesListAdminTestJSON-416114152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b824a65c-f249-4ee4-9054-04e5b04ca8a5" returned: 0 in 0.527s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cbc7bfbf-8be3-48f3-a938-f091bb9a5e69 tempest-VolumesListAdminTestJSON-416114152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b824a65c-f249-4ee4-9054-04e5b04ca8a5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:14 devstack sudo[100828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b824a65c-f249-4ee4-9054-04e5b04ca8a5
Nov 19 13:15:14 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:14 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cbc7bfbf-8be3-48f3-a938-f091bb9a5e69 tempest-VolumesListAdminTestJSON-416114152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b824a65c-f249-4ee4-9054-04e5b04ca8a5" returned: 0 in 0.422s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:14 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-cbc7bfbf-8be3-48f3-a938-f091bb9a5e69 tempest-VolumesListAdminTestJSON-416114152 None] Lock "cinder-quobyte-b824a65c-f249-4ee4-9054-04e5b04ca8a5" released by "delete_volume" :: held 0.973s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:14 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-cbc7bfbf-8be3-48f3-a938-f091bb9a5e69 tempest-VolumesListAdminTestJSON-416114152 None] Created reservations ['c71071e2-ea1c-4963-9c59-08d51e686ed8', '7aba9341-0183-495f-ad82-97556c02c0ab', 'bec9cf00-34b6-423b-8cf1-7d0968c2ee6f', 'b867c42f-410c-4ee5-9063-9e056b145c9d'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:15:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cbc7bfbf-8be3-48f3-a938-f091bb9a5e69 tempest-VolumesListAdminTestJSON-416114152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cbc7bfbf-8be3-48f3-a938-f091bb9a5e69 tempest-VolumesListAdminTestJSON-416114152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:14 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-cbc7bfbf-8be3-48f3-a938-f091bb9a5e69 tempest-VolumesListAdminTestJSON-416114152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:15:14 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-cbc7bfbf-8be3-48f3-a938-f091bb9a5e69 tempest-VolumesListAdminTestJSON-416114152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:15:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cbc7bfbf-8be3-48f3-a938-f091bb9a5e69 tempest-VolumesListAdminTestJSON-416114152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cbc7bfbf-8be3-48f3-a938-f091bb9a5e69 tempest-VolumesListAdminTestJSON-416114152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:14 devstack sudo[100831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:15:14 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:14 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5eadd0ef-ed6b-4bcd-85dd-e7695277e40b tempest-VolumesListAdminTestJSON-416114152 None] Acquiring lock "cinder-898a83af-94ce-49db-8ba6-e18d7f3869cd-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:14 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5eadd0ef-ed6b-4bcd-85dd-e7695277e40b tempest-VolumesListAdminTestJSON-416114152 None] Lock "cinder-898a83af-94ce-49db-8ba6-e18d7f3869cd-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:14 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5eadd0ef-ed6b-4bcd-85dd-e7695277e40b tempest-VolumesListAdminTestJSON-416114152 None] Acquiring lock "cinder-quobyte-898a83af-94ce-49db-8ba6-e18d7f3869cd" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:14 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5eadd0ef-ed6b-4bcd-85dd-e7695277e40b tempest-VolumesListAdminTestJSON-416114152 None] Lock "cinder-quobyte-898a83af-94ce-49db-8ba6-e18d7f3869cd" acquired by "delete_volume" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:14 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9245dde1-a660-4797-a41e-2ba2bba1b01a]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:15:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5eadd0ef-ed6b-4bcd-85dd-e7695277e40b tempest-VolumesListAdminTestJSON-416114152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-898a83af-94ce-49db-8ba6-e18d7f3869cd {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:14 devstack sudo[100833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-898a83af-94ce-49db-8ba6-e18d7f3869cd
Nov 19 13:15:14 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:14 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cbc7bfbf-8be3-48f3-a938-f091bb9a5e69 tempest-VolumesListAdminTestJSON-416114152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.452s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:15 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-cbc7bfbf-8be3-48f3-a938-f091bb9a5e69 tempest-VolumesListAdminTestJSON-416114152 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:15:15 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-cbc7bfbf-8be3-48f3-a938-f091bb9a5e69 tempest-VolumesListAdminTestJSON-416114152 None] Deleted volume successfully.
Nov 19 13:15:15 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-cbc7bfbf-8be3-48f3-a938-f091bb9a5e69 tempest-VolumesListAdminTestJSON-416114152 None] Lock "cinder-b824a65c-f249-4ee4-9054-04e5b04ca8a5-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:15 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5eadd0ef-ed6b-4bcd-85dd-e7695277e40b tempest-VolumesListAdminTestJSON-416114152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-898a83af-94ce-49db-8ba6-e18d7f3869cd" returned: 0 in 0.528s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5eadd0ef-ed6b-4bcd-85dd-e7695277e40b tempest-VolumesListAdminTestJSON-416114152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-898a83af-94ce-49db-8ba6-e18d7f3869cd {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:15 devstack sudo[100839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-898a83af-94ce-49db-8ba6-e18d7f3869cd
Nov 19 13:15:15 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:15 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5eadd0ef-ed6b-4bcd-85dd-e7695277e40b tempest-VolumesListAdminTestJSON-416114152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-898a83af-94ce-49db-8ba6-e18d7f3869cd" returned: 0 in 0.424s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:15 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5eadd0ef-ed6b-4bcd-85dd-e7695277e40b tempest-VolumesListAdminTestJSON-416114152 None] Lock "cinder-quobyte-898a83af-94ce-49db-8ba6-e18d7f3869cd" released by "delete_volume" :: held 0.971s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:15 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-5eadd0ef-ed6b-4bcd-85dd-e7695277e40b tempest-VolumesListAdminTestJSON-416114152 None] Created reservations ['52395c8d-eed7-4f58-9d37-8fd7a70ba9b3', 'f893862c-024a-4aa5-93d5-2bfa43fcbde0', 'a8c2b586-e07b-4844-af4b-b70611d9bff7', '5417f26b-585f-461a-bfe0-53e2d7796158'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:15:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5eadd0ef-ed6b-4bcd-85dd-e7695277e40b tempest-VolumesListAdminTestJSON-416114152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5eadd0ef-ed6b-4bcd-85dd-e7695277e40b tempest-VolumesListAdminTestJSON-416114152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:15 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5eadd0ef-ed6b-4bcd-85dd-e7695277e40b tempest-VolumesListAdminTestJSON-416114152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:15:15 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5eadd0ef-ed6b-4bcd-85dd-e7695277e40b tempest-VolumesListAdminTestJSON-416114152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:15:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5eadd0ef-ed6b-4bcd-85dd-e7695277e40b tempest-VolumesListAdminTestJSON-416114152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5eadd0ef-ed6b-4bcd-85dd-e7695277e40b tempest-VolumesListAdminTestJSON-416114152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:15 devstack sudo[100842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:15:15 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:16 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5eadd0ef-ed6b-4bcd-85dd-e7695277e40b tempest-VolumesListAdminTestJSON-416114152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.474s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:16 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-5eadd0ef-ed6b-4bcd-85dd-e7695277e40b tempest-VolumesListAdminTestJSON-416114152 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:15:16 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-5eadd0ef-ed6b-4bcd-85dd-e7695277e40b tempest-VolumesListAdminTestJSON-416114152 None] Deleted volume successfully.
Nov 19 13:15:16 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5eadd0ef-ed6b-4bcd-85dd-e7695277e40b tempest-VolumesListAdminTestJSON-416114152 None] Lock "cinder-898a83af-94ce-49db-8ba6-e18d7f3869cd-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:18 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:15:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Flow 'volume_create_manager' (46401020-b38f-432f-a575-d9897abfb4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:15:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5c3b1d9-ba97-4ca6-b754-f30895b158ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5c3b1d9-ba97-4ca6-b754-f30895b158ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-149007592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ef9a89-8e58-4459-a6b2-187b141b1d0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5dd5852321b4b9aacbe8381aaf35675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:15:18Z,use_quota=True,user_id='66b73e69d02b423e8281d7c31d5c1039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34aa2a99-d8d3-4645-8599-43a3783d3118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34aa2a99-d8d3-4645-8599-43a3783d3118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36dde875-04fa-486b-a978-107ea4bc323e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36dde875-04fa-486b-a978-107ea4bc323e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1ef9a89-8e58-4459-a6b2-187b141b1d0e', 'volume_name': 'volume-e1ef9a89-8e58-4459-a6b2-187b141b1d0e', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697250de-5f01-49e4-8428-ffccc822bbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697250de-5f01-49e4-8428-ffccc822bbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb3e718-c1b5-44e1-9048-4456557fda71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:18 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Volume e1ef9a89-8e58-4459-a6b2-187b141b1d0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1ef9a89-8e58-4459-a6b2-187b141b1d0e', 'volume_size': 1}
Nov 19 13:15:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-149007592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ef9a89-8e58-4459-a6b2-187b141b1d0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5dd5852321b4b9aacbe8381aaf35675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:15:18Z,use_quota=True,user_id='66b73e69d02b423e8281d7c31d5c1039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:15:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Creating volume e1ef9a89-8e58-4459-a6b2-187b141b1d0e {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:15:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:15:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:15:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:15:18 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:15:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e1ef9a89-8e58-4459-a6b2-187b141b1d0e 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:18 devstack sudo[100845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e1ef9a89-8e58-4459-a6b2-187b141b1d0e 1073741824
Nov 19 13:15:18 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:19 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e1ef9a89-8e58-4459-a6b2-187b141b1d0e 1073741824" returned: 0 in 0.503s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e1ef9a89-8e58-4459-a6b2-187b141b1d0e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:19 devstack sudo[100850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e1ef9a89-8e58-4459-a6b2-187b141b1d0e
Nov 19 13:15:19 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:19 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e1ef9a89-8e58-4459-a6b2-187b141b1d0e" returned: 0 in 0.450s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:19 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:15:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:19 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb3e718-c1b5-44e1-9048-4456557fda71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1ef9a89-8e58-4459-a6b2-187b141b1d0e', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:19 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b13993-4566-49e5-aab2-67dfa12025ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:19 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Volume volume-e1ef9a89-8e58-4459-a6b2-187b141b1d0e (e1ef9a89-8e58-4459-a6b2-187b141b1d0e): created successfully
Nov 19 13:15:19 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b13993-4566-49e5-aab2-67dfa12025ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:19 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Flow 'volume_create_manager' (46401020-b38f-432f-a575-d9897abfb4a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:15:19 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-5f74d580-1a3d-4f2c-aa6f-51eadaee1da5 tempest-AbsoluteLimitsTests-1489228818 None] Created volume successfully.
Nov 19 13:15:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-1c37ed16-edbe-4a59-88a2-b502002447a3 tempest-AbsoluteLimitsTests-1489228818 None] Acquiring lock "cinder-e1ef9a89-8e58-4459-a6b2-187b141b1d0e-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-1c37ed16-edbe-4a59-88a2-b502002447a3 tempest-AbsoluteLimitsTests-1489228818 None] Lock "cinder-e1ef9a89-8e58-4459-a6b2-187b141b1d0e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-1c37ed16-edbe-4a59-88a2-b502002447a3 tempest-AbsoluteLimitsTests-1489228818 None] Acquiring lock "cinder-quobyte-e1ef9a89-8e58-4459-a6b2-187b141b1d0e" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-1c37ed16-edbe-4a59-88a2-b502002447a3 tempest-AbsoluteLimitsTests-1489228818 None] Lock "cinder-quobyte-e1ef9a89-8e58-4459-a6b2-187b141b1d0e" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:20 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c8e0a0-eca6-4b06-b852-da48d25b8c1d]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:15:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1c37ed16-edbe-4a59-88a2-b502002447a3 tempest-AbsoluteLimitsTests-1489228818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e1ef9a89-8e58-4459-a6b2-187b141b1d0e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:20 devstack sudo[100853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e1ef9a89-8e58-4459-a6b2-187b141b1d0e
Nov 19 13:15:20 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:21 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1c37ed16-edbe-4a59-88a2-b502002447a3 tempest-AbsoluteLimitsTests-1489228818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e1ef9a89-8e58-4459-a6b2-187b141b1d0e" returned: 0 in 0.514s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1c37ed16-edbe-4a59-88a2-b502002447a3 tempest-AbsoluteLimitsTests-1489228818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e1ef9a89-8e58-4459-a6b2-187b141b1d0e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:21 devstack sudo[100858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e1ef9a89-8e58-4459-a6b2-187b141b1d0e
Nov 19 13:15:21 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:21 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1c37ed16-edbe-4a59-88a2-b502002447a3 tempest-AbsoluteLimitsTests-1489228818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e1ef9a89-8e58-4459-a6b2-187b141b1d0e" returned: 0 in 0.427s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:21 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-1c37ed16-edbe-4a59-88a2-b502002447a3 tempest-AbsoluteLimitsTests-1489228818 None] Lock "cinder-quobyte-e1ef9a89-8e58-4459-a6b2-187b141b1d0e" released by "delete_volume" :: held 0.961s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:21 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-1c37ed16-edbe-4a59-88a2-b502002447a3 tempest-AbsoluteLimitsTests-1489228818 None] Created reservations ['c75ad1db-d28b-444b-89b6-9d17551815a3', '6f995173-bc3e-458a-9bd5-65b1f2ed53d6', '2bbca82f-3241-47f7-b961-778851adec4e', 'c64f1f50-da7a-4923-b3af-ac6dc221d051'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:15:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1c37ed16-edbe-4a59-88a2-b502002447a3 tempest-AbsoluteLimitsTests-1489228818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1c37ed16-edbe-4a59-88a2-b502002447a3 tempest-AbsoluteLimitsTests-1489228818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:21 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1c37ed16-edbe-4a59-88a2-b502002447a3 tempest-AbsoluteLimitsTests-1489228818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:15:21 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1c37ed16-edbe-4a59-88a2-b502002447a3 tempest-AbsoluteLimitsTests-1489228818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:15:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1c37ed16-edbe-4a59-88a2-b502002447a3 tempest-AbsoluteLimitsTests-1489228818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1c37ed16-edbe-4a59-88a2-b502002447a3 tempest-AbsoluteLimitsTests-1489228818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:21 devstack sudo[100861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:15:21 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:22 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1c37ed16-edbe-4a59-88a2-b502002447a3 tempest-AbsoluteLimitsTests-1489228818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.493s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:22 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-1c37ed16-edbe-4a59-88a2-b502002447a3 tempest-AbsoluteLimitsTests-1489228818 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:15:22 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-1c37ed16-edbe-4a59-88a2-b502002447a3 tempest-AbsoluteLimitsTests-1489228818 None] Deleted volume successfully.
Nov 19 13:15:22 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-1c37ed16-edbe-4a59-88a2-b502002447a3 tempest-AbsoluteLimitsTests-1489228818 None] Lock "cinder-e1ef9a89-8e58-4459-a6b2-187b141b1d0e-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:23 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:15:23 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Flow 'volume_create_manager' (44f9a36c-17a3-4334-b370-ddc13efc548e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:15:23 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8acc982b-6796-4e81-a93e-ba5b81f5698a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:23 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8acc982b-6796-4e81-a93e-ba5b81f5698a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1462568469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768569f0-e63f-4919-8f1a-75ef7952b483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83a42a54bff428e8e8deb5ce7067c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:15:24Z,use_quota=True,user_id='773e5a91d8a1438789ad4023389b3e66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:23 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787f2d32-a0bf-4077-88fe-e0d15640b153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:23 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787f2d32-a0bf-4077-88fe-e0d15640b153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:23 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88356b41-aa68-478c-b0db-3f4a52397f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:23 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88356b41-aa68-478c-b0db-3f4a52397f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '768569f0-e63f-4919-8f1a-75ef7952b483', 'volume_name': 'volume-768569f0-e63f-4919-8f1a-75ef7952b483', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:23 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a1d0dc-0137-4afc-af19-51b7e8b9a7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:23 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a1d0dc-0137-4afc-af19-51b7e8b9a7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:23 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc9c3cc-1ade-47f0-8cbb-acbcd8e26c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:23 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Volume 768569f0-e63f-4919-8f1a-75ef7952b483: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-768569f0-e63f-4919-8f1a-75ef7952b483', 'volume_size': 1}
Nov 19 13:15:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1462568469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768569f0-e63f-4919-8f1a-75ef7952b483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83a42a54bff428e8e8deb5ce7067c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:15:24Z,use_quota=True,user_id='773e5a91d8a1438789ad4023389b3e66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:15:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Creating volume 768569f0-e63f-4919-8f1a-75ef7952b483 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:15:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:15:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:15:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:15:23 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:15:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:24 devstack sudo[100865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483 1073741824
Nov 19 13:15:24 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:24 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483 1073741824" returned: 0 in 0.511s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:24 devstack sudo[100870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483
Nov 19 13:15:24 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:24 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483" returned: 0 in 0.425s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:24 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:15:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:24 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc9c3cc-1ade-47f0-8cbb-acbcd8e26c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-768569f0-e63f-4919-8f1a-75ef7952b483', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:24 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f64cfa4-30c2-4fcb-9d56-0db7971ea4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:24 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Volume volume-768569f0-e63f-4919-8f1a-75ef7952b483 (768569f0-e63f-4919-8f1a-75ef7952b483): created successfully
Nov 19 13:15:24 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f64cfa4-30c2-4fcb-9d56-0db7971ea4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:24 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Flow 'volume_create_manager' (44f9a36c-17a3-4334-b370-ddc13efc548e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:15:24 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-e410daa6-06cd-472d-85d9-ac69cbb887ea tempest-VolumesDeleteCascade-78175480 None] Created volume successfully.
Nov 19 13:15:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f5e9e1da-7bb1-475e-98ae-a8264d12d4f5 tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f5e9e1da-7bb1-475e-98ae-a8264d12d4f5 tempest-VolumesDeleteCascade-78175480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-f5e9e1da-7bb1-475e-98ae-a8264d12d4f5 tempest-VolumesDeleteCascade-78175480 None] Creating offline snapshot 405a2c2a-24ae-4b68-a11a-b853740deae5 of volume 768569f0-e63f-4919-8f1a-75ef7952b483 {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 13:15:26 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a880c5-15de-4f40-83cb-ae2ef03e5497]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:15:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5e9e1da-7bb1-475e-98ae-a8264d12d4f5 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:26 devstack sudo[100873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483
Nov 19 13:15:26 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:26 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5e9e1da-7bb1-475e-98ae-a8264d12d4f5 tempest-VolumesDeleteCascade-78175480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483" returned: 0 in 0.527s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5e9e1da-7bb1-475e-98ae-a8264d12d4f5 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:26 devstack sudo[100878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5 1G
Nov 19 13:15:26 devstack sudo[100878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:27 devstack sudo[100878]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5e9e1da-7bb1-475e-98ae-a8264d12d4f5 tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5 1G" returned: 0 in 0.487s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5e9e1da-7bb1-475e-98ae-a8264d12d4f5 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-768569f0-e63f-4919-8f1a-75ef7952b483 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:27 devstack sudo[100883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-768569f0-e63f-4919-8f1a-75ef7952b483 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5
Nov 19 13:15:27 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:27 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5e9e1da-7bb1-475e-98ae-a8264d12d4f5 tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-768569f0-e63f-4919-8f1a-75ef7952b483 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5" returned: 0 in 0.448s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:27 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-f5e9e1da-7bb1-475e-98ae-a8264d12d4f5 tempest-VolumesDeleteCascade-78175480 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5 is being set with open permissions: ugo+rw
Nov 19 13:15:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5e9e1da-7bb1-475e-98ae-a8264d12d4f5 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:27 devstack sudo[100888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5
Nov 19 13:15:27 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:28 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5e9e1da-7bb1-475e-98ae-a8264d12d4f5 tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5" returned: 0 in 0.418s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5e9e1da-7bb1-475e-98ae-a8264d12d4f5 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:28 devstack sudo[100891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.info
Nov 19 13:15:28 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:28 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5e9e1da-7bb1-475e-98ae-a8264d12d4f5 tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.info" returned: 0 in 0.438s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:28 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-f5e9e1da-7bb1-475e-98ae-a8264d12d4f5 tempest-VolumesDeleteCascade-78175480 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.info is being set with open permissions: ugo+rw
Nov 19 13:15:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5e9e1da-7bb1-475e-98ae-a8264d12d4f5 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:28 devstack sudo[100894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.info
Nov 19 13:15:28 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:28 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f5e9e1da-7bb1-475e-98ae-a8264d12d4f5 tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.info" returned: 0 in 0.417s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f5e9e1da-7bb1-475e-98ae-a8264d12d4f5 tempest-VolumesDeleteCascade-78175480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.775s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:28 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-f5e9e1da-7bb1-475e-98ae-a8264d12d4f5 tempest-VolumesDeleteCascade-78175480 None] Create snapshot completed successfully
Nov 19 13:15:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-52a7ae91-0755-4394-a418-21172f5819db tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-52a7ae91-0755-4394-a418-21172f5819db tempest-VolumesDeleteCascade-78175480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:29 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-52a7ae91-0755-4394-a418-21172f5819db tempest-VolumesDeleteCascade-78175480 None] Creating offline snapshot 3982d322-7a61-4d59-aea4-cc5b5591a08e of volume 768569f0-e63f-4919-8f1a-75ef7952b483 {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 13:15:29 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a83551e-b085-4ed2-9cdb-84bda251bbf0]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:15:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-52a7ae91-0755-4394-a418-21172f5819db tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:29 devstack sudo[100897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5
Nov 19 13:15:29 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:29 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-52a7ae91-0755-4394-a418-21172f5819db tempest-VolumesDeleteCascade-78175480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5" returned: 0 in 0.521s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:29 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-52a7ae91-0755-4394-a418-21172f5819db tempest-VolumesDeleteCascade-78175480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-768569f0-e63f-4919-8f1a-75ef7952b483(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:15:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-52a7ae91-0755-4394-a418-21172f5819db tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.3982d322-7a61-4d59-aea4-cc5b5591a08e 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:29 devstack sudo[100902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.3982d322-7a61-4d59-aea4-cc5b5591a08e 1G
Nov 19 13:15:29 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:30 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-52a7ae91-0755-4394-a418-21172f5819db tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.3982d322-7a61-4d59-aea4-cc5b5591a08e 1G" returned: 0 in 0.510s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-52a7ae91-0755-4394-a418-21172f5819db tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.3982d322-7a61-4d59-aea4-cc5b5591a08e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:30 devstack sudo[100907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.3982d322-7a61-4d59-aea4-cc5b5591a08e
Nov 19 13:15:30 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:30 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-52a7ae91-0755-4394-a418-21172f5819db tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.3982d322-7a61-4d59-aea4-cc5b5591a08e" returned: 0 in 0.440s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:30 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-52a7ae91-0755-4394-a418-21172f5819db tempest-VolumesDeleteCascade-78175480 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.3982d322-7a61-4d59-aea4-cc5b5591a08e is being set with open permissions: ugo+rw
Nov 19 13:15:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-52a7ae91-0755-4394-a418-21172f5819db tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.3982d322-7a61-4d59-aea4-cc5b5591a08e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:30 devstack sudo[100912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.3982d322-7a61-4d59-aea4-cc5b5591a08e
Nov 19 13:15:30 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:31 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-52a7ae91-0755-4394-a418-21172f5819db tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.3982d322-7a61-4d59-aea4-cc5b5591a08e" returned: 0 in 0.419s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-52a7ae91-0755-4394-a418-21172f5819db tempest-VolumesDeleteCascade-78175480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.947s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:31 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-52a7ae91-0755-4394-a418-21172f5819db tempest-VolumesDeleteCascade-78175480 None] Create snapshot completed successfully
Nov 19 13:15:31 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "cinder-768569f0-e63f-4919-8f1a-75ef7952b483-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:31 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-768569f0-e63f-4919-8f1a-75ef7952b483-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Performing cascade delete. {{(pid=80839) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 19 13:15:31 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "cinder-3982d322-7a61-4d59-aea4-cc5b5591a08e-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:31 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-3982d322-7a61-4d59-aea4-cc5b5591a08e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.006s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:31 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "cinder-quobyte-768569f0-e63f-4919-8f1a-75ef7952b483" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:31 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-quobyte-768569f0-e63f-4919-8f1a-75ef7952b483" acquired by "delete_snapshot" :: waited 0.005s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:31 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "cinder-quobyte-3982d322-7a61-4d59-aea4-cc5b5591a08e" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:31 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-quobyte-3982d322-7a61-4d59-aea4-cc5b5591a08e" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Deleting offline snapshot 3982d322-7a61-4d59-aea4-cc5b5591a08e of volume 768569f0-e63f-4919-8f1a-75ef7952b483 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 13:15:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] snapshot_file for this snap is: volume-768569f0-e63f-4919-8f1a-75ef7952b483.3982d322-7a61-4d59-aea4-cc5b5591a08e {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 13:15:31 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73f8632-0938-487f-a034-ce8cf4560cf8]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:15:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.3982d322-7a61-4d59-aea4-cc5b5591a08e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:31 devstack sudo[100915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.3982d322-7a61-4d59-aea4-cc5b5591a08e
Nov 19 13:15:31 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:32 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.3982d322-7a61-4d59-aea4-cc5b5591a08e" returned: 0 in 0.514s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:32 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-768569f0-e63f-4919-8f1a-75ef7952b483(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:15:32 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f9fd7d-f8c8-4504-9814-8b856f2169fc]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:15:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:32 devstack sudo[100920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5
Nov 19 13:15:32 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:32 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5" returned: 0 in 0.535s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:32 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-768569f0-e63f-4919-8f1a-75ef7952b483(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:15:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.3982d322-7a61-4d59-aea4-cc5b5591a08e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:32 devstack sudo[100925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.3982d322-7a61-4d59-aea4-cc5b5591a08e
Nov 19 13:15:32 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:33 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.3982d322-7a61-4d59-aea4-cc5b5591a08e" returned: 0 in 0.471s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.3982d322-7a61-4d59-aea4-cc5b5591a08e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:33 devstack sudo[100931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.3982d322-7a61-4d59-aea4-cc5b5591a08e
Nov 19 13:15:33 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:33 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.3982d322-7a61-4d59-aea4-cc5b5591a08e" returned: 0 in 0.419s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-quobyte-3982d322-7a61-4d59-aea4-cc5b5591a08e" released by "_delete_snapshot" :: held 1.991s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-quobyte-768569f0-e63f-4919-8f1a-75ef7952b483" released by "delete_snapshot" :: held 1.999s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:33 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Created reservations ['65719253-7467-4ef8-9abd-ca30503bcfba', '8a4b7f23-0a36-4ac5-8aec-c8120a1f5a96', '6aff22a4-78a2-41f7-a95b-b9a23053e93e', '310f7199-74c0-442d-b78c-668304cbba5f'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:15:33 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Delete snapshot completed successfully.
Nov 19 13:15:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-3982d322-7a61-4d59-aea4-cc5b5591a08e-delete_snapshot" released by "delete_snapshot" :: held 2.089s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "cinder-405a2c2a-24ae-4b68-a11a-b853740deae5-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-405a2c2a-24ae-4b68-a11a-b853740deae5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.005s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "cinder-quobyte-768569f0-e63f-4919-8f1a-75ef7952b483" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-quobyte-768569f0-e63f-4919-8f1a-75ef7952b483" acquired by "delete_snapshot" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "cinder-quobyte-405a2c2a-24ae-4b68-a11a-b853740deae5" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-quobyte-405a2c2a-24ae-4b68-a11a-b853740deae5" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:33 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Deleting offline snapshot 405a2c2a-24ae-4b68-a11a-b853740deae5 of volume 768569f0-e63f-4919-8f1a-75ef7952b483 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 13:15:33 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] snapshot_file for this snap is: volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 13:15:33 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[36853ace-76c3-4914-874a-3e17adaa9dc5]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:15:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:33 devstack sudo[100934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5
Nov 19 13:15:33 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:34 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5" returned: 0 in 0.519s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:34 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-768569f0-e63f-4919-8f1a-75ef7952b483(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:15:34 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4ba8e2-89ba-4a3f-877e-be5e68814b29]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:15:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:34 devstack sudo[100939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483
Nov 19 13:15:34 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:34 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483" returned: 0 in 0.522s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:34 devstack sudo[100944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5
Nov 19 13:15:34 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:35 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5" returned: 0 in 0.448s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:35 devstack sudo[100949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5
Nov 19 13:15:35 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:35 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483.405a2c2a-24ae-4b68-a11a-b853740deae5" returned: 0 in 0.420s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:35 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-quobyte-405a2c2a-24ae-4b68-a11a-b853740deae5" released by "_delete_snapshot" :: held 1.960s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:35 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-quobyte-768569f0-e63f-4919-8f1a-75ef7952b483" released by "delete_snapshot" :: held 1.971s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:35 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Created reservations ['5ecfce84-5e53-44c1-8f8a-8ff7005719d6', 'beda5649-a2df-46dd-91d7-5f419d7b44bb', 'ab7edbb8-81c5-467d-a69d-c2d87b73a930', '7c686e0d-0705-4eeb-a8f6-32b3a2af391f'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:15:35 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Delete snapshot completed successfully.
Nov 19 13:15:35 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-405a2c2a-24ae-4b68-a11a-b853740deae5-delete_snapshot" released by "delete_snapshot" :: held 2.054s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:35 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Snapshots deleted, issuing volume delete {{(pid=80839) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 19 13:15:35 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "cinder-quobyte-768569f0-e63f-4919-8f1a-75ef7952b483" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:35 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-quobyte-768569f0-e63f-4919-8f1a-75ef7952b483" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:35 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5562d0e5-4c01-41d6-9113-2e10079d77cf]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:15:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:35 devstack sudo[100958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483
Nov 19 13:15:35 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:36 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483" returned: 0 in 0.516s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:36 devstack sudo[100963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483
Nov 19 13:15:36 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:36 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-768569f0-e63f-4919-8f1a-75ef7952b483" returned: 0 in 0.444s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:36 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-quobyte-768569f0-e63f-4919-8f1a-75ef7952b483" released by "delete_volume" :: held 0.986s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:36 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Created reservations ['46069070-829f-4b4f-88ae-d01e76c4590b', '29d909ef-0dfb-4b41-a762-9f169d975f75', 'a9b8001e-1bff-4fb1-9ed0-b27c1f015400', 'f9558096-ae42-416f-862f-9e8a35cab4e4'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:15:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:36 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:15:36 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:15:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:36 devstack sudo[100966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:15:36 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:37 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:15:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Flow 'volume_create_manager' (d548c896-359c-45af-a986-f81cf07ec9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:15:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777c1b23-e121-486b-b281-bab03c76a8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777c1b23-e121-486b-b281-bab03c76a8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-934143363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cb656e-bd95-4eef-b3ca-4757a5862862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83a42a54bff428e8e8deb5ce7067c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:15:37Z,use_quota=True,user_id='773e5a91d8a1438789ad4023389b3e66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b427e99-c65c-49b5-a295-f4615460968a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b427e99-c65c-49b5-a295-f4615460968a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567ab508-25b0-44b4-9637-a255d1498f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567ab508-25b0-44b4-9637-a255d1498f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62cb656e-bd95-4eef-b3ca-4757a5862862', 'volume_name': 'volume-62cb656e-bd95-4eef-b3ca-4757a5862862', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c259b269-0425-4094-9c50-94371bb200e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c259b269-0425-4094-9c50-94371bb200e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:37 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ecfb17-7874-4b02-8929-3cc594324686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:37 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Volume 62cb656e-bd95-4eef-b3ca-4757a5862862: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62cb656e-bd95-4eef-b3ca-4757a5862862', 'volume_size': 1}
Nov 19 13:15:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:37 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-934143363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cb656e-bd95-4eef-b3ca-4757a5862862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83a42a54bff428e8e8deb5ce7067c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:15:37Z,use_quota=True,user_id='773e5a91d8a1438789ad4023389b3e66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:15:37 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Creating volume 62cb656e-bd95-4eef-b3ca-4757a5862862 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:15:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:37 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:15:37 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:15:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:37 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:15:37 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:15:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:37 devstack sudo[101002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862 1073741824
Nov 19 13:15:37 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:37 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.480s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:37 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:15:37 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Deleted volume successfully.
Nov 19 13:15:37 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-24c7112f-3585-456b-a3e1-9e8cd5609898 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-768569f0-e63f-4919-8f1a-75ef7952b483-delete_volume" released by "delete_volume" :: held 5.747s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:37 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862 1073741824" returned: 0 in 0.501s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:37 devstack sudo[101008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862
Nov 19 13:15:37 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:38 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862" returned: 0 in 0.413s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:38 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:15:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:38 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ecfb17-7874-4b02-8929-3cc594324686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62cb656e-bd95-4eef-b3ca-4757a5862862', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:38 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d9af9b-b259-4616-b8c0-13b5b63c6193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:38 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Volume volume-62cb656e-bd95-4eef-b3ca-4757a5862862 (62cb656e-bd95-4eef-b3ca-4757a5862862): created successfully
Nov 19 13:15:38 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d9af9b-b259-4616-b8c0-13b5b63c6193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:38 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Flow 'volume_create_manager' (d548c896-359c-45af-a986-f81cf07ec9f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:15:38 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-42042b70-995e-4d19-9f32-831c95b143d4 tempest-VolumesDeleteCascade-78175480 None] Created volume successfully.
Nov 19 13:15:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5e7350e3-c8a8-4a52-90ac-b5db8bf76f94 tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5e7350e3-c8a8-4a52-90ac-b5db8bf76f94 tempest-VolumesDeleteCascade-78175480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:39 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-5e7350e3-c8a8-4a52-90ac-b5db8bf76f94 tempest-VolumesDeleteCascade-78175480 None] Creating offline snapshot ae1215a4-21c2-45b6-9314-2a1800c2d324 of volume 62cb656e-bd95-4eef-b3ca-4757a5862862 {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 13:15:39 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8702869-90ba-45e2-ab9e-15f68fb29d41]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:15:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5e7350e3-c8a8-4a52-90ac-b5db8bf76f94 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:39 devstack sudo[101011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862
Nov 19 13:15:39 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:39 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5e7350e3-c8a8-4a52-90ac-b5db8bf76f94 tempest-VolumesDeleteCascade-78175480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862" returned: 0 in 0.524s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5e7350e3-c8a8-4a52-90ac-b5db8bf76f94 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.ae1215a4-21c2-45b6-9314-2a1800c2d324 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:39 devstack sudo[101016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.ae1215a4-21c2-45b6-9314-2a1800c2d324 1G
Nov 19 13:15:39 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:40 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5e7350e3-c8a8-4a52-90ac-b5db8bf76f94 tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.ae1215a4-21c2-45b6-9314-2a1800c2d324 1G" returned: 0 in 0.497s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5e7350e3-c8a8-4a52-90ac-b5db8bf76f94 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62cb656e-bd95-4eef-b3ca-4757a5862862 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.ae1215a4-21c2-45b6-9314-2a1800c2d324 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:40 devstack sudo[101021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62cb656e-bd95-4eef-b3ca-4757a5862862 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.ae1215a4-21c2-45b6-9314-2a1800c2d324
Nov 19 13:15:40 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:40 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5e7350e3-c8a8-4a52-90ac-b5db8bf76f94 tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62cb656e-bd95-4eef-b3ca-4757a5862862 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.ae1215a4-21c2-45b6-9314-2a1800c2d324" returned: 0 in 0.450s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:40 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-5e7350e3-c8a8-4a52-90ac-b5db8bf76f94 tempest-VolumesDeleteCascade-78175480 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.ae1215a4-21c2-45b6-9314-2a1800c2d324 is being set with open permissions: ugo+rw
Nov 19 13:15:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5e7350e3-c8a8-4a52-90ac-b5db8bf76f94 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.ae1215a4-21c2-45b6-9314-2a1800c2d324 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:40 devstack sudo[101027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.ae1215a4-21c2-45b6-9314-2a1800c2d324
Nov 19 13:15:40 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:41 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5e7350e3-c8a8-4a52-90ac-b5db8bf76f94 tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.ae1215a4-21c2-45b6-9314-2a1800c2d324" returned: 0 in 0.416s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5e7350e3-c8a8-4a52-90ac-b5db8bf76f94 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:41 devstack sudo[101030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.info
Nov 19 13:15:41 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:41 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5e7350e3-c8a8-4a52-90ac-b5db8bf76f94 tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.info" returned: 0 in 0.441s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:41 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-5e7350e3-c8a8-4a52-90ac-b5db8bf76f94 tempest-VolumesDeleteCascade-78175480 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.info is being set with open permissions: ugo+rw
Nov 19 13:15:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5e7350e3-c8a8-4a52-90ac-b5db8bf76f94 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:41 devstack sudo[101033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.info
Nov 19 13:15:41 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:42 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5e7350e3-c8a8-4a52-90ac-b5db8bf76f94 tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.info" returned: 0 in 0.420s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5e7350e3-c8a8-4a52-90ac-b5db8bf76f94 tempest-VolumesDeleteCascade-78175480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.786s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:42 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-5e7350e3-c8a8-4a52-90ac-b5db8bf76f94 tempest-VolumesDeleteCascade-78175480 None] Create snapshot completed successfully
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Flow 'volume_create_manager' (7fc2702b-acf3-49ee-a6c0-f985a11c2cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf1be93b-5b54-47f4-bcf6-906f6b7f32ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf1be93b-5b54-47f4-bcf6-906f6b7f32ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1533738343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e1d93c-6d7c-4b83-9587-3d5fb3c69d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b83a42a54bff428e8e8deb5ce7067c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ae1215a4-21c2-45b6-9314-2a1800c2d324,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:15:43Z,use_quota=True,user_id='773e5a91d8a1438789ad4023389b3e66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddedd928-07d8-4a98-a4d1-6abf466ca7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddedd928-07d8-4a98-a4d1-6abf466ca7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc18057b-ed35-45c8-b178-09c1468fbd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc18057b-ed35-45c8-b178-09c1468fbd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '79e1d93c-6d7c-4b83-9587-3d5fb3c69d03', 'volume_name': 'volume-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03', 'volume_size': 1, 'snapshot_id': 'ae1215a4-21c2-45b6-9314-2a1800c2d324'}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d7e156-480e-41cd-9217-3069993c661a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d7e156-480e-41cd-9217-3069993c661a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e52193-20d2-4876-8171-0ac4c0d1517b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:42 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Volume 79e1d93c-6d7c-4b83-9587-3d5fb3c69d03: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03', 'volume_size': 1, 'snapshot_id': 'ae1215a4-21c2-45b6-9314-2a1800c2d324'}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "cinder-quobyte-ae1215a4-21c2-45b6-9314-2a1800c2d324-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03" by "_create_volume_from_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-quobyte-ae1215a4-21c2-45b6-9314-2a1800c2d324-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Creating volume 79e1d93c-6d7c-4b83-9587-3d5fb3c69d03 from snapshot ae1215a4-21c2-45b6-9314-2a1800c2d324 {{(pid=80839) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "cinder-quobyte-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03" by "_copy_volume_from_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-quobyte-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] snapshot: ae1215a4-21c2-45b6-9314-2a1800c2d324, volume: 79e1d93c-6d7c-4b83-9587-3d5fb3c69d03,  {{(pid=80839) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:392}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f246279-0245-4f04-a98b-5c8002247050]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:15:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.ae1215a4-21c2-45b6-9314-2a1800c2d324 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:42 devstack sudo[101036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.ae1215a4-21c2-45b6-9314-2a1800c2d324
Nov 19 13:15:42 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:43 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.ae1215a4-21c2-45b6-9314-2a1800c2d324" returned: 0 in 0.507s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:43 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62cb656e-bd95-4eef-b3ca-4757a5862862(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:15:43 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862 {{(pid=80839) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:411}}
Nov 19 13:15:43 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Creating direct copy from snapshot {{(pid=80839) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:419}}
Nov 19 13:15:43 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[61061cd0-d4ee-4750-a7f2-5632e8f2c807]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:15:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:43 devstack sudo[101042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862
Nov 19 13:15:43 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:43 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862" returned: 0 in 0.517s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:43 devstack cinder-volume[80839]: DEBUG cinder.utils [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Path /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03 not found in is_blk_device check {{(pid=80839) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Nov 19 13:15:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:43 devstack sudo[101047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03
Nov 19 13:15:43 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:45 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03" returned: 0 in 1.819s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:45 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57df450-b762-46f7-8774-595e51d1a392]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:15:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:45 devstack sudo[101060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862
Nov 19 13:15:45 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:46 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862" returned: 0 in 0.643s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:46 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Image conversion details: src /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862, size 1024.00 MB, duration 1.82 sec, destination /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03 {{(pid=80839) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 19 13:15:46 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Converted 1024.00 MB image at 562.41 MB/s
Nov 19 13:15:46 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03 is being set with open permissions: ugo+rw
Nov 19 13:15:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:46 devstack sudo[101065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03
Nov 19 13:15:46 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:46 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03" returned: 0 in 0.426s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:46 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-quobyte-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03" released by "_copy_volume_from_snapshot" :: held 3.976s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:46 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-quobyte-ae1215a4-21c2-45b6-9314-2a1800c2d324-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03" released by "_create_volume_from_snapshot" :: held 3.991s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.998s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e52193-20d2-4876-8171-0ac4c0d1517b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03', 'volume_size': 1, 'snapshot_id': 'ae1215a4-21c2-45b6-9314-2a1800c2d324'}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d094825b-f915-41ab-b151-022cd75407cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:46 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Volume volume-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03 (79e1d93c-6d7c-4b83-9587-3d5fb3c69d03): created successfully
Nov 19 13:15:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d094825b-f915-41ab-b151-022cd75407cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Flow 'volume_create_manager' (7fc2702b-acf3-49ee-a6c0-f985a11c2cc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:15:46 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-56bd7b52-16d7-4fc4-8c80-62ad2a121861 tempest-VolumesDeleteCascade-78175480 None] Created volume successfully.
Nov 19 13:15:47 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "cinder-62cb656e-bd95-4eef-b3ca-4757a5862862-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:47 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-62cb656e-bd95-4eef-b3ca-4757a5862862-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Performing cascade delete. {{(pid=80839) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 19 13:15:47 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "cinder-ae1215a4-21c2-45b6-9314-2a1800c2d324-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:47 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-ae1215a4-21c2-45b6-9314-2a1800c2d324-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:47 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "cinder-quobyte-62cb656e-bd95-4eef-b3ca-4757a5862862" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:47 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-quobyte-62cb656e-bd95-4eef-b3ca-4757a5862862" acquired by "delete_snapshot" :: waited 0.006s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:47 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "cinder-quobyte-ae1215a4-21c2-45b6-9314-2a1800c2d324" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:47 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-quobyte-ae1215a4-21c2-45b6-9314-2a1800c2d324" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Deleting offline snapshot ae1215a4-21c2-45b6-9314-2a1800c2d324 of volume 62cb656e-bd95-4eef-b3ca-4757a5862862 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 13:15:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] snapshot_file for this snap is: volume-62cb656e-bd95-4eef-b3ca-4757a5862862.ae1215a4-21c2-45b6-9314-2a1800c2d324 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 13:15:47 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bc4c1a-2f69-453d-a11b-9ee5fd94e940]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:15:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.ae1215a4-21c2-45b6-9314-2a1800c2d324 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:47 devstack sudo[101068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.ae1215a4-21c2-45b6-9314-2a1800c2d324
Nov 19 13:15:47 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:47 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.ae1215a4-21c2-45b6-9314-2a1800c2d324" returned: 0 in 0.516s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62cb656e-bd95-4eef-b3ca-4757a5862862(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:15:47 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0ca13e-f63e-4117-af78-935fa88153ac]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:15:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:47 devstack sudo[101073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862
Nov 19 13:15:47 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:48 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862" returned: 0 in 0.534s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.ae1215a4-21c2-45b6-9314-2a1800c2d324 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:48 devstack sudo[101078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.ae1215a4-21c2-45b6-9314-2a1800c2d324
Nov 19 13:15:48 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:48 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.ae1215a4-21c2-45b6-9314-2a1800c2d324" returned: 0 in 0.454s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.ae1215a4-21c2-45b6-9314-2a1800c2d324 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:48 devstack sudo[101083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.ae1215a4-21c2-45b6-9314-2a1800c2d324
Nov 19 13:15:48 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:49 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862.ae1215a4-21c2-45b6-9314-2a1800c2d324" returned: 0 in 0.429s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:49 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-quobyte-ae1215a4-21c2-45b6-9314-2a1800c2d324" released by "_delete_snapshot" :: held 2.105s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:49 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-quobyte-62cb656e-bd95-4eef-b3ca-4757a5862862" released by "delete_snapshot" :: held 2.115s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:49 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Created reservations ['46e33bf0-0976-428b-bed0-f54d1809121b', 'f0a1346d-cf9b-4dc5-94c5-49cf129047d6', '21a95e0d-11dc-4025-8b35-9d6351c62cbc', '106af527-0439-458b-b6bc-065c52d897ae'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:15:49 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Delete snapshot completed successfully.
Nov 19 13:15:49 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-ae1215a4-21c2-45b6-9314-2a1800c2d324-delete_snapshot" released by "delete_snapshot" :: held 2.199s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Snapshots deleted, issuing volume delete {{(pid=80839) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 19 13:15:49 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "cinder-quobyte-62cb656e-bd95-4eef-b3ca-4757a5862862" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:49 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-quobyte-62cb656e-bd95-4eef-b3ca-4757a5862862" acquired by "delete_volume" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:49 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa67e62-fec1-4891-b52b-4bbd8dadbe76]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:15:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:49 devstack sudo[101086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862
Nov 19 13:15:49 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:49 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862" returned: 0 in 0.514s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:49 devstack sudo[101091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862
Nov 19 13:15:49 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:50 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-62cb656e-bd95-4eef-b3ca-4757a5862862" returned: 0 in 0.415s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:50 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-quobyte-62cb656e-bd95-4eef-b3ca-4757a5862862" released by "delete_volume" :: held 0.954s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:50 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Created reservations ['c5a952b2-5b58-4017-a1a8-23b6514d032e', 'e1e7886e-1c52-4a59-89d4-2f1916985720', 'df631bbc-973b-4ed0-b6db-143cb084508c', '2c8b133f-57f8-4f67-9fd9-851d7a097ef3'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:15:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:50 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:15:50 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:15:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:50 devstack sudo[101094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:15:50 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:50 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.433s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:50 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:15:50 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Deleted volume successfully.
Nov 19 13:15:50 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-030c8d11-10a9-46f0-b172-053ad639c438 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-62cb656e-bd95-4eef-b3ca-4757a5862862-delete_volume" released by "delete_volume" :: held 3.718s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:51 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-584fed14-349b-4eca-ae31-e351113b19d3 tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "cinder-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:51 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-584fed14-349b-4eca-ae31-e351113b19d3 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:51 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-584fed14-349b-4eca-ae31-e351113b19d3 tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "cinder-quobyte-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:51 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-584fed14-349b-4eca-ae31-e351113b19d3 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-quobyte-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:51 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea33ec1-2971-4f47-a661-82f4b748bf27]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:15:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-584fed14-349b-4eca-ae31-e351113b19d3 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:51 devstack sudo[101097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03
Nov 19 13:15:51 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:51 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-584fed14-349b-4eca-ae31-e351113b19d3 tempest-VolumesDeleteCascade-78175480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03" returned: 0 in 0.512s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-584fed14-349b-4eca-ae31-e351113b19d3 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:51 devstack sudo[101102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03
Nov 19 13:15:51 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:52 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-584fed14-349b-4eca-ae31-e351113b19d3 tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03" returned: 0 in 0.412s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:52 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-584fed14-349b-4eca-ae31-e351113b19d3 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-quobyte-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03" released by "delete_volume" :: held 0.950s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:52 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-584fed14-349b-4eca-ae31-e351113b19d3 tempest-VolumesDeleteCascade-78175480 None] Created reservations ['67ef657b-5f73-4e56-ae5b-b145e6fb0263', '625f5508-e7a0-49f0-b6f4-59592437718f', '5d2d66d3-2422-406b-ba42-28944d350bfb', 'c411db80-39b7-4bde-a514-6ec279c1e414'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:15:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-584fed14-349b-4eca-ae31-e351113b19d3 tempest-VolumesDeleteCascade-78175480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-584fed14-349b-4eca-ae31-e351113b19d3 tempest-VolumesDeleteCascade-78175480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-584fed14-349b-4eca-ae31-e351113b19d3 tempest-VolumesDeleteCascade-78175480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:15:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-584fed14-349b-4eca-ae31-e351113b19d3 tempest-VolumesDeleteCascade-78175480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:15:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-584fed14-349b-4eca-ae31-e351113b19d3 tempest-VolumesDeleteCascade-78175480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-584fed14-349b-4eca-ae31-e351113b19d3 tempest-VolumesDeleteCascade-78175480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:52 devstack sudo[101105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:15:52 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:52 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-584fed14-349b-4eca-ae31-e351113b19d3 tempest-VolumesDeleteCascade-78175480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.479s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:52 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-584fed14-349b-4eca-ae31-e351113b19d3 tempest-VolumesDeleteCascade-78175480 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:15:52 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-584fed14-349b-4eca-ae31-e351113b19d3 tempest-VolumesDeleteCascade-78175480 None] Deleted volume successfully.
Nov 19 13:15:52 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-584fed14-349b-4eca-ae31-e351113b19d3 tempest-VolumesDeleteCascade-78175480 None] Lock "cinder-79e1d93c-6d7c-4b83-9587-3d5fb3c69d03-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:54 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:15:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Flow 'volume_create_manager' (ee4a96e2-8369-4f02-96d2-447f04634322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:15:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0b4f870-3353-47ea-8183-134d6d4e7a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0b4f870-3353-47ea-8183-134d6d4e7a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1755429600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d847817b9b42c781ec6d64fec6fda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:15:55Z,use_quota=True,user_id='4f5cf02dbda647cdb3d3043123d330f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae63365e-4c21-4164-a697-541074557bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae63365e-4c21-4164-a697-541074557bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b9ee9f-984a-4582-8e1c-8b12494e80ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b9ee9f-984a-4582-8e1c-8b12494e80ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc', 'volume_name': 'volume-2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e25edc-67a6-4e38-859a-3d37f4ef540f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e25edc-67a6-4e38-859a-3d37f4ef540f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067f804e-6306-4e8c-8bab-6fc6e524e9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:54 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Volume 2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc', 'volume_size': 1}
Nov 19 13:15:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:54 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1755429600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d847817b9b42c781ec6d64fec6fda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:15:55Z,use_quota=True,user_id='4f5cf02dbda647cdb3d3043123d330f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:15:54 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Creating volume 2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:15:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:54 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:15:54 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:15:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:54 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:15:54 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:15:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:54 devstack sudo[101112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc 1073741824
Nov 19 13:15:54 devstack sudo[101112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:55 devstack sudo[101112]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc 1073741824" returned: 0 in 0.528s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:55 devstack sudo[101117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc
Nov 19 13:15:55 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:55 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc" returned: 0 in 0.420s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:55 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:15:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067f804e-6306-4e8c-8bab-6fc6e524e9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165d9acd-c01b-40f0-8d3b-3dd02285b4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:55 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Volume volume-2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc (2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc): created successfully
Nov 19 13:15:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165d9acd-c01b-40f0-8d3b-3dd02285b4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Flow 'volume_create_manager' (ee4a96e2-8369-4f02-96d2-447f04634322) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:15:55 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-951bf7cd-5ad6-4a69-91f5-d5360bf597cc tempest-VolumesTransfersTest-1293640157 None] Created volume successfully.
Nov 19 13:15:57 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-1a3d1d83-3ac4-45a0-8ed2-7958a125a14c tempest-VolumesTransfersTest-1992450464 None] Transfer volume completed successfully.
Nov 19 13:15:58 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-74ae514b-517c-459a-b5cb-f647251c3e21 tempest-VolumesTransfersTest-1498185839 None] Acquiring lock "cinder-2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:58 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-74ae514b-517c-459a-b5cb-f647251c3e21 tempest-VolumesTransfersTest-1498185839 None] Lock "cinder-2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:58 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-74ae514b-517c-459a-b5cb-f647251c3e21 tempest-VolumesTransfersTest-1498185839 None] Acquiring lock "cinder-quobyte-2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:15:58 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-74ae514b-517c-459a-b5cb-f647251c3e21 tempest-VolumesTransfersTest-1498185839 None] Lock "cinder-quobyte-2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc" acquired by "delete_volume" :: waited 0.015s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:15:58 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc543852-a125-4073-8b2d-3ae188f8082b]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:15:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-74ae514b-517c-459a-b5cb-f647251c3e21 tempest-VolumesTransfersTest-1498185839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:58 devstack sudo[101120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc
Nov 19 13:15:58 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:58 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-74ae514b-517c-459a-b5cb-f647251c3e21 tempest-VolumesTransfersTest-1498185839 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc" returned: 0 in 0.511s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-74ae514b-517c-459a-b5cb-f647251c3e21 tempest-VolumesTransfersTest-1498185839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:58 devstack sudo[101125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc
Nov 19 13:15:58 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:59 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-74ae514b-517c-459a-b5cb-f647251c3e21 tempest-VolumesTransfersTest-1498185839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc" returned: 0 in 0.419s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-74ae514b-517c-459a-b5cb-f647251c3e21 tempest-VolumesTransfersTest-1498185839 None] Lock "cinder-quobyte-2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc" released by "delete_volume" :: held 0.952s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-74ae514b-517c-459a-b5cb-f647251c3e21 tempest-VolumesTransfersTest-1498185839 None] Created reservations ['0d31fe9a-b951-47e9-9e97-87e3a2ab2ea9', 'dbbd11b9-8600-451e-8e2c-ba69b6a69f13', 'c28fba7a-57e0-4c6f-9edc-110cf958a7c1', '962a1dcd-a78c-4528-a0c8-3fde2e15dc3e'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-74ae514b-517c-459a-b5cb-f647251c3e21 tempest-VolumesTransfersTest-1498185839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-74ae514b-517c-459a-b5cb-f647251c3e21 tempest-VolumesTransfersTest-1498185839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-74ae514b-517c-459a-b5cb-f647251c3e21 tempest-VolumesTransfersTest-1498185839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-74ae514b-517c-459a-b5cb-f647251c3e21 tempest-VolumesTransfersTest-1498185839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-74ae514b-517c-459a-b5cb-f647251c3e21 tempest-VolumesTransfersTest-1498185839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-74ae514b-517c-459a-b5cb-f647251c3e21 tempest-VolumesTransfersTest-1498185839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:59 devstack sudo[101128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:15:59 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Flow 'volume_create_manager' (daf02758-37de-4d27-a776-a1ef2b8f8d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad8cf839-18bf-4ee3-8ff0-28684be17fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad8cf839-18bf-4ee3-8ff0-28684be17fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-830535587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fbda6b0-b40a-47ab-982b-d67c1d04d3a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d847817b9b42c781ec6d64fec6fda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:15:59Z,use_quota=True,user_id='4f5cf02dbda647cdb3d3043123d330f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c35781-92fa-4a38-a697-ce9d2943b6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c35781-92fa-4a38-a697-ce9d2943b6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de89d77e-d7fb-4ffc-a29e-7e4c3262a7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de89d77e-d7fb-4ffc-a29e-7e4c3262a7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fbda6b0-b40a-47ab-982b-d67c1d04d3a2', 'volume_name': 'volume-2fbda6b0-b40a-47ab-982b-d67c1d04d3a2', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a56227f-5d29-4e15-a6a2-2f3e4e7d9fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a56227f-5d29-4e15-a6a2-2f3e4e7d9fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f735038e-0227-49ee-bb2f-214b9c4a5ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:15:59 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Volume 2fbda6b0-b40a-47ab-982b-d67c1d04d3a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fbda6b0-b40a-47ab-982b-d67c1d04d3a2', 'volume_size': 1}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-830535587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fbda6b0-b40a-47ab-982b-d67c1d04d3a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d847817b9b42c781ec6d64fec6fda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:15:59Z,use_quota=True,user_id='4f5cf02dbda647cdb3d3043123d330f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Creating volume 2fbda6b0-b40a-47ab-982b-d67c1d04d3a2 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:15:59 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2fbda6b0-b40a-47ab-982b-d67c1d04d3a2 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:15:59 devstack sudo[101130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2fbda6b0-b40a-47ab-982b-d67c1d04d3a2 1073741824
Nov 19 13:15:59 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:15:59 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-74ae514b-517c-459a-b5cb-f647251c3e21 tempest-VolumesTransfersTest-1498185839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.451s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-74ae514b-517c-459a-b5cb-f647251c3e21 tempest-VolumesTransfersTest-1498185839 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:15:59 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-74ae514b-517c-459a-b5cb-f647251c3e21 tempest-VolumesTransfersTest-1498185839 None] Deleted volume successfully.
Nov 19 13:15:59 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-74ae514b-517c-459a-b5cb-f647251c3e21 tempest-VolumesTransfersTest-1498185839 None] Lock "cinder-2acd3ce4-05bd-41ee-835f-7d3eedf7ebbc-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:16:00 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2fbda6b0-b40a-47ab-982b-d67c1d04d3a2 1073741824" returned: 0 in 0.517s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2fbda6b0-b40a-47ab-982b-d67c1d04d3a2 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:00 devstack sudo[101136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2fbda6b0-b40a-47ab-982b-d67c1d04d3a2
Nov 19 13:16:00 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:00 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2fbda6b0-b40a-47ab-982b-d67c1d04d3a2" returned: 0 in 0.409s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:00 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:16:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:16:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f735038e-0227-49ee-bb2f-214b9c4a5ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fbda6b0-b40a-47ab-982b-d67c1d04d3a2', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a23207-e7fc-48f4-94fa-83c1a93973d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:00 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Volume volume-2fbda6b0-b40a-47ab-982b-d67c1d04d3a2 (2fbda6b0-b40a-47ab-982b-d67c1d04d3a2): created successfully
Nov 19 13:16:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a23207-e7fc-48f4-94fa-83c1a93973d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:00 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Flow 'volume_create_manager' (daf02758-37de-4d27-a776-a1ef2b8f8d75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:16:00 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-8e7de33f-bb93-4805-b54f-129ecd5bf4d9 tempest-VolumesTransfersTest-1293640157 None] Created volume successfully.
Nov 19 13:16:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-db89081d-dbc2-4e74-bca0-2b3c70379233 tempest-VolumesTransfersTest-1498185839 None] Acquiring lock "cinder-2fbda6b0-b40a-47ab-982b-d67c1d04d3a2-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:16:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-db89081d-dbc2-4e74-bca0-2b3c70379233 tempest-VolumesTransfersTest-1498185839 None] Lock "cinder-2fbda6b0-b40a-47ab-982b-d67c1d04d3a2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:16:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-db89081d-dbc2-4e74-bca0-2b3c70379233 tempest-VolumesTransfersTest-1498185839 None] Acquiring lock "cinder-quobyte-2fbda6b0-b40a-47ab-982b-d67c1d04d3a2" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:16:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-db89081d-dbc2-4e74-bca0-2b3c70379233 tempest-VolumesTransfersTest-1498185839 None] Lock "cinder-quobyte-2fbda6b0-b40a-47ab-982b-d67c1d04d3a2" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:16:01 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1031be-4826-48f6-a17d-0519c020d4ef]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:16:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-db89081d-dbc2-4e74-bca0-2b3c70379233 tempest-VolumesTransfersTest-1498185839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2fbda6b0-b40a-47ab-982b-d67c1d04d3a2 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:01 devstack sudo[101139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2fbda6b0-b40a-47ab-982b-d67c1d04d3a2
Nov 19 13:16:01 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:02 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-db89081d-dbc2-4e74-bca0-2b3c70379233 tempest-VolumesTransfersTest-1498185839 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2fbda6b0-b40a-47ab-982b-d67c1d04d3a2" returned: 0 in 0.512s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-db89081d-dbc2-4e74-bca0-2b3c70379233 tempest-VolumesTransfersTest-1498185839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2fbda6b0-b40a-47ab-982b-d67c1d04d3a2 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:02 devstack sudo[101144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2fbda6b0-b40a-47ab-982b-d67c1d04d3a2
Nov 19 13:16:02 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:02 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-db89081d-dbc2-4e74-bca0-2b3c70379233 tempest-VolumesTransfersTest-1498185839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-2fbda6b0-b40a-47ab-982b-d67c1d04d3a2" returned: 0 in 0.431s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:02 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-db89081d-dbc2-4e74-bca0-2b3c70379233 tempest-VolumesTransfersTest-1498185839 None] Lock "cinder-quobyte-2fbda6b0-b40a-47ab-982b-d67c1d04d3a2" released by "delete_volume" :: held 0.967s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:16:02 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-db89081d-dbc2-4e74-bca0-2b3c70379233 tempest-VolumesTransfersTest-1498185839 None] Created reservations ['3238deb3-bef1-47f9-8a0e-fce6d12d0a1e', 'e1d7bef8-e1bc-4dd3-b693-54c8ce36da99', '7328feb9-4648-41c8-abf1-87158d42a6f5', 'defaea34-9c88-45b7-b14a-25c4a425967d'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:16:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-db89081d-dbc2-4e74-bca0-2b3c70379233 tempest-VolumesTransfersTest-1498185839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:16:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-db89081d-dbc2-4e74-bca0-2b3c70379233 tempest-VolumesTransfersTest-1498185839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:16:02 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-db89081d-dbc2-4e74-bca0-2b3c70379233 tempest-VolumesTransfersTest-1498185839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:16:02 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-db89081d-dbc2-4e74-bca0-2b3c70379233 tempest-VolumesTransfersTest-1498185839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:16:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-db89081d-dbc2-4e74-bca0-2b3c70379233 tempest-VolumesTransfersTest-1498185839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:16:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-db89081d-dbc2-4e74-bca0-2b3c70379233 tempest-VolumesTransfersTest-1498185839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:02 devstack sudo[101147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:16:02 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:03 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-db89081d-dbc2-4e74-bca0-2b3c70379233 tempest-VolumesTransfersTest-1498185839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.448s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:03 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-db89081d-dbc2-4e74-bca0-2b3c70379233 tempest-VolumesTransfersTest-1498185839 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:16:03 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-db89081d-dbc2-4e74-bca0-2b3c70379233 tempest-VolumesTransfersTest-1498185839 None] Deleted volume successfully.
Nov 19 13:16:03 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-db89081d-dbc2-4e74-bca0-2b3c70379233 tempest-VolumesTransfersTest-1498185839 None] Lock "cinder-2fbda6b0-b40a-47ab-982b-d67c1d04d3a2-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:16:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 13:16:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:16:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:16:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:16:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:16:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:16:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:04 devstack sudo[101151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:16:04 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:05 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.538s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:05 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:16:12 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=83,cinder:UPDATE=127,cinder:DELETE=10,cinder:INSERT=35 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:16:12 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:UPDATE=106,cinder:SELECT=80,cinder:INSERT=17,cinder:DELETE=11 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:16:12 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:16:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Flow 'volume_create_manager' (3e5b6987-c628-4fd8-8444-e24a1d93680d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:16:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (227c5f05-1bb0-4010-a772-19f9ecf39faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (227c5f05-1bb0-4010-a772-19f9ecf39faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1674065663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7057b59-41f6-474c-9fc3-01b6af0f7b14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f9bd30cd1441659ec2379aefb3f9f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:16:12Z,use_quota=True,user_id='333d23e5cb4b4014942b5640df7ad31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98fb7772-b580-4d0d-869f-52d6b7d8ead4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98fb7772-b580-4d0d-869f-52d6b7d8ead4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7253de61-7016-4000-a4ce-383928a25be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7253de61-7016-4000-a4ce-383928a25be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7057b59-41f6-474c-9fc3-01b6af0f7b14', 'volume_name': 'volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (871527d6-4087-45b1-a3ab-9f6f6b04f736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (871527d6-4087-45b1-a3ab-9f6f6b04f736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:12 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d76ac8f-0185-4732-8a4c-51c01a430470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:12 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Volume a7057b59-41f6-474c-9fc3-01b6af0f7b14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14', 'volume_size': 1}
Nov 19 13:16:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:16:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:16:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1674065663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7057b59-41f6-474c-9fc3-01b6af0f7b14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f9bd30cd1441659ec2379aefb3f9f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:16:12Z,use_quota=True,user_id='333d23e5cb4b4014942b5640df7ad31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:16:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Creating volume a7057b59-41f6-474c-9fc3-01b6af0f7b14 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:16:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:16:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:16:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:16:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:16:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:16:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:16:12 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:16:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:12 devstack sudo[101154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14 1073741824
Nov 19 13:16:12 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:12 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14 1073741824" returned: 0 in 0.505s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:12 devstack sudo[101160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14
Nov 19 13:16:12 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:13 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14" returned: 0 in 0.413s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:13 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:16:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:16:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d76ac8f-0185-4732-8a4c-51c01a430470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4c1a8d-4d65-46ae-a74d-cb81033143ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:13 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Volume volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14 (a7057b59-41f6-474c-9fc3-01b6af0f7b14): created successfully
Nov 19 13:16:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4c1a8d-4d65-46ae-a74d-cb81033143ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Flow 'volume_create_manager' (3e5b6987-c628-4fd8-8444-e24a1d93680d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:16:13 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-c181b738-314c-4c7d-9459-17a33dc72ce4 tempest-VolumesSnapshotTestJSON-621435841 None] Created volume successfully.
Nov 19 13:16:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-21c42492-3e94-4784-a1b4-9b494f1dd036 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:16:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-21c42492-3e94-4784-a1b4-9b494f1dd036 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:16:14 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-21c42492-3e94-4784-a1b4-9b494f1dd036 tempest-VolumesSnapshotTestJSON-621435841 None] Creating offline snapshot 2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9 of volume a7057b59-41f6-474c-9fc3-01b6af0f7b14 {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 13:16:14 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb38e48-da56-4213-8e2f-39d1adaca6f8]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:16:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-21c42492-3e94-4784-a1b4-9b494f1dd036 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:14 devstack sudo[101163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14
Nov 19 13:16:14 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:15 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-21c42492-3e94-4784-a1b4-9b494f1dd036 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14" returned: 0 in 0.518s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-21c42492-3e94-4784-a1b4-9b494f1dd036 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14.2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:15 devstack sudo[101168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14.2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9 1G
Nov 19 13:16:15 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:15 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-21c42492-3e94-4784-a1b4-9b494f1dd036 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14.2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9 1G" returned: 0 in 0.492s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-21c42492-3e94-4784-a1b4-9b494f1dd036 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14.2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:15 devstack sudo[101173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14.2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9
Nov 19 13:16:15 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:15 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-21c42492-3e94-4784-a1b4-9b494f1dd036 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14.2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9" returned: 0 in 0.428s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:15 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-21c42492-3e94-4784-a1b4-9b494f1dd036 tempest-VolumesSnapshotTestJSON-621435841 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14.2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9 is being set with open permissions: ugo+rw
Nov 19 13:16:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-21c42492-3e94-4784-a1b4-9b494f1dd036 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14.2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:16 devstack sudo[101178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14.2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9
Nov 19 13:16:16 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:16 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-21c42492-3e94-4784-a1b4-9b494f1dd036 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14.2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9" returned: 0 in 0.413s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-21c42492-3e94-4784-a1b4-9b494f1dd036 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:16 devstack sudo[101181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14.info
Nov 19 13:16:16 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:16 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-21c42492-3e94-4784-a1b4-9b494f1dd036 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14.info" returned: 0 in 0.421s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:16 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-21c42492-3e94-4784-a1b4-9b494f1dd036 tempest-VolumesSnapshotTestJSON-621435841 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14.info is being set with open permissions: ugo+rw
Nov 19 13:16:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-21c42492-3e94-4784-a1b4-9b494f1dd036 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:16 devstack sudo[101184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14.info
Nov 19 13:16:16 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:17 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-21c42492-3e94-4784-a1b4-9b494f1dd036 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14.info" returned: 0 in 0.420s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-21c42492-3e94-4784-a1b4-9b494f1dd036 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.728s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:16:17 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-21c42492-3e94-4784-a1b4-9b494f1dd036 tempest-VolumesSnapshotTestJSON-621435841 None] Create snapshot completed successfully
Nov 19 13:16:17 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8d42e03c-7742-4d01-a060-77702a22008b tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "cinder-2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:16:17 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8d42e03c-7742-4d01-a060-77702a22008b tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:16:17 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8d42e03c-7742-4d01-a060-77702a22008b tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "cinder-quobyte-a7057b59-41f6-474c-9fc3-01b6af0f7b14" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:16:17 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8d42e03c-7742-4d01-a060-77702a22008b tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-a7057b59-41f6-474c-9fc3-01b6af0f7b14" acquired by "delete_snapshot" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:16:17 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8d42e03c-7742-4d01-a060-77702a22008b tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "cinder-quobyte-2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:16:17 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8d42e03c-7742-4d01-a060-77702a22008b tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:16:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-8d42e03c-7742-4d01-a060-77702a22008b tempest-VolumesSnapshotTestJSON-621435841 None] Deleting offline snapshot 2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9 of volume a7057b59-41f6-474c-9fc3-01b6af0f7b14 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 13:16:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-8d42e03c-7742-4d01-a060-77702a22008b tempest-VolumesSnapshotTestJSON-621435841 None] snapshot_file for this snap is: volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14.2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 13:16:17 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c894170-06d8-4715-acce-515b71ce2d00]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:16:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8d42e03c-7742-4d01-a060-77702a22008b tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14.2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:17 devstack sudo[101188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14.2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9
Nov 19 13:16:17 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:18 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8d42e03c-7742-4d01-a060-77702a22008b tempest-VolumesSnapshotTestJSON-621435841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14.2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9" returned: 0 in 0.529s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-8d42e03c-7742-4d01-a060-77702a22008b tempest-VolumesSnapshotTestJSON-621435841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:16:18 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e3f5ae-1ccb-4469-ad19-c381429e63d1]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:16:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8d42e03c-7742-4d01-a060-77702a22008b tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:18 devstack sudo[101193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14
Nov 19 13:16:18 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:18 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8d42e03c-7742-4d01-a060-77702a22008b tempest-VolumesSnapshotTestJSON-621435841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14" returned: 0 in 0.515s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8d42e03c-7742-4d01-a060-77702a22008b tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14.2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:18 devstack sudo[101198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14.2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9
Nov 19 13:16:18 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:19 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8d42e03c-7742-4d01-a060-77702a22008b tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14.2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9" returned: 0 in 0.456s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8d42e03c-7742-4d01-a060-77702a22008b tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14.2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:19 devstack sudo[101203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14.2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9
Nov 19 13:16:19 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:19 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8d42e03c-7742-4d01-a060-77702a22008b tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14.2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9" returned: 0 in 0.422s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:19 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8d42e03c-7742-4d01-a060-77702a22008b tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9" released by "_delete_snapshot" :: held 1.986s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:16:19 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8d42e03c-7742-4d01-a060-77702a22008b tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-a7057b59-41f6-474c-9fc3-01b6af0f7b14" released by "delete_snapshot" :: held 1.998s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:16:19 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-8d42e03c-7742-4d01-a060-77702a22008b tempest-VolumesSnapshotTestJSON-621435841 None] Created reservations ['bb05c808-244d-4f48-b171-6d7d7fa167b2', '202e69ae-3514-4f2e-9e91-fd52add288e4', '8cb54005-d3e0-49a2-9edf-be614b1b0cfe', 'f4e8e29b-3b60-4e2f-b338-79b8236c718d'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:16:19 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-8d42e03c-7742-4d01-a060-77702a22008b tempest-VolumesSnapshotTestJSON-621435841 None] Delete snapshot completed successfully.
Nov 19 13:16:19 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8d42e03c-7742-4d01-a060-77702a22008b tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-2e0a4e4d-cff6-4853-bc8b-3fa90c03f0a9-delete_snapshot" released by "delete_snapshot" :: held 2.100s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:16:21 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:16:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Flow 'volume_create_manager' (dd536196-dfc8-425d-8eef-7b824fa867bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:16:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5042edf-42e9-443d-a435-bbb798eb5086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5042edf-42e9-443d-a435-bbb798eb5086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1109397519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d465cd-1c62-4480-af6f-34a566d1fc43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f9bd30cd1441659ec2379aefb3f9f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:16:21Z,use_quota=True,user_id='333d23e5cb4b4014942b5640df7ad31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a3ff0f2-920c-497d-8dd3-476d324772a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a3ff0f2-920c-497d-8dd3-476d324772a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f80795-7dc1-4fcf-9d18-ee1ad087c73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f80795-7dc1-4fcf-9d18-ee1ad087c73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15d465cd-1c62-4480-af6f-34a566d1fc43', 'volume_name': 'volume-15d465cd-1c62-4480-af6f-34a566d1fc43', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c25959-eb32-43fc-aabc-3718f5b979e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c25959-eb32-43fc-aabc-3718f5b979e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbfcff5b-4eb0-4869-a503-abc69e9ca6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:21 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Volume 15d465cd-1c62-4480-af6f-34a566d1fc43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15d465cd-1c62-4480-af6f-34a566d1fc43', 'volume_size': 1}
Nov 19 13:16:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:16:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:16:21 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1109397519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d465cd-1c62-4480-af6f-34a566d1fc43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f9bd30cd1441659ec2379aefb3f9f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:16:21Z,use_quota=True,user_id='333d23e5cb4b4014942b5640df7ad31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:16:21 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Creating volume 15d465cd-1c62-4480-af6f-34a566d1fc43 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:16:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:16:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:16:21 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:16:21 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:16:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:16:21 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:16:21 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:16:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:21 devstack sudo[101206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43 1073741824
Nov 19 13:16:21 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:21 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43 1073741824" returned: 0 in 0.504s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:21 devstack sudo[101211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43
Nov 19 13:16:21 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:22 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43" returned: 0 in 0.420s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:22 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:16:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:16:22 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbfcff5b-4eb0-4869-a503-abc69e9ca6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15d465cd-1c62-4480-af6f-34a566d1fc43', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:22 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745e39e5-eb37-4c92-97a9-b261fe5c7915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:22 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Volume volume-15d465cd-1c62-4480-af6f-34a566d1fc43 (15d465cd-1c62-4480-af6f-34a566d1fc43): created successfully
Nov 19 13:16:22 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745e39e5-eb37-4c92-97a9-b261fe5c7915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:22 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Flow 'volume_create_manager' (dd536196-dfc8-425d-8eef-7b824fa867bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:16:22 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-b0858a18-4064-4b72-94ff-cf8ab58d0a36 tempest-VolumesSnapshotTestJSON-621435841 None] Created volume successfully.
Nov 19 13:16:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4ad0ea88-8172-48b9-b36a-f29728d56d28 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:16:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4ad0ea88-8172-48b9-b36a-f29728d56d28 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:16:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-4ad0ea88-8172-48b9-b36a-f29728d56d28 tempest-VolumesSnapshotTestJSON-621435841 None] Creating offline snapshot f898562a-2c7d-4168-9897-22bd33beb6b5 of volume 15d465cd-1c62-4480-af6f-34a566d1fc43 {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 13:16:23 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de4e877-9964-4d76-bf1f-6deb3980a9dc]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:16:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4ad0ea88-8172-48b9-b36a-f29728d56d28 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:23 devstack sudo[101215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43
Nov 19 13:16:23 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:23 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4ad0ea88-8172-48b9-b36a-f29728d56d28 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43" returned: 0 in 0.520s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4ad0ea88-8172-48b9-b36a-f29728d56d28 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.f898562a-2c7d-4168-9897-22bd33beb6b5 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:23 devstack sudo[101220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.f898562a-2c7d-4168-9897-22bd33beb6b5 1G
Nov 19 13:16:23 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:24 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4ad0ea88-8172-48b9-b36a-f29728d56d28 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.f898562a-2c7d-4168-9897-22bd33beb6b5 1G" returned: 0 in 0.469s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4ad0ea88-8172-48b9-b36a-f29728d56d28 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15d465cd-1c62-4480-af6f-34a566d1fc43 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.f898562a-2c7d-4168-9897-22bd33beb6b5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:24 devstack sudo[101225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15d465cd-1c62-4480-af6f-34a566d1fc43 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.f898562a-2c7d-4168-9897-22bd33beb6b5
Nov 19 13:16:24 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:24 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4ad0ea88-8172-48b9-b36a-f29728d56d28 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15d465cd-1c62-4480-af6f-34a566d1fc43 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.f898562a-2c7d-4168-9897-22bd33beb6b5" returned: 0 in 0.442s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:24 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-4ad0ea88-8172-48b9-b36a-f29728d56d28 tempest-VolumesSnapshotTestJSON-621435841 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.f898562a-2c7d-4168-9897-22bd33beb6b5 is being set with open permissions: ugo+rw
Nov 19 13:16:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4ad0ea88-8172-48b9-b36a-f29728d56d28 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.f898562a-2c7d-4168-9897-22bd33beb6b5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:24 devstack sudo[101230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.f898562a-2c7d-4168-9897-22bd33beb6b5
Nov 19 13:16:24 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:25 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4ad0ea88-8172-48b9-b36a-f29728d56d28 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.f898562a-2c7d-4168-9897-22bd33beb6b5" returned: 0 in 0.403s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4ad0ea88-8172-48b9-b36a-f29728d56d28 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:25 devstack sudo[101233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.info
Nov 19 13:16:25 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:25 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4ad0ea88-8172-48b9-b36a-f29728d56d28 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.info" returned: 0 in 0.423s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:25 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-4ad0ea88-8172-48b9-b36a-f29728d56d28 tempest-VolumesSnapshotTestJSON-621435841 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.info is being set with open permissions: ugo+rw
Nov 19 13:16:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4ad0ea88-8172-48b9-b36a-f29728d56d28 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:25 devstack sudo[101236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.info
Nov 19 13:16:25 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:25 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4ad0ea88-8172-48b9-b36a-f29728d56d28 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.info" returned: 0 in 0.409s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4ad0ea88-8172-48b9-b36a-f29728d56d28 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.702s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:16:25 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-4ad0ea88-8172-48b9-b36a-f29728d56d28 tempest-VolumesSnapshotTestJSON-621435841 None] Create snapshot completed successfully
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Flow 'volume_create_manager' (e30d1058-1722-4c22-b267-688a07cbd230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9439c95-de67-4844-be29-83beca54a826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9439c95-de67-4844-be29-83beca54a826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-432758864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb4b992-1508-49bf-8743-22cdcbfd934c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f9bd30cd1441659ec2379aefb3f9f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:16:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=f898562a-2c7d-4168-9897-22bd33beb6b5,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:16:27Z,use_quota=True,user_id='333d23e5cb4b4014942b5640df7ad31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa056e5-f212-4655-bd4e-33efeb1c2985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa056e5-f212-4655-bd4e-33efeb1c2985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa8d55ff-6304-4f94-86e0-8801c8737ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa8d55ff-6304-4f94-86e0-8801c8737ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dfb4b992-1508-49bf-8743-22cdcbfd934c', 'volume_name': 'volume-dfb4b992-1508-49bf-8743-22cdcbfd934c', 'volume_size': 2, 'snapshot_id': 'f898562a-2c7d-4168-9897-22bd33beb6b5'}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d7298e-6d4e-49c0-983b-179459899707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d7298e-6d4e-49c0-983b-179459899707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae18267-5ca2-4c4b-9061-e6e1109daade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:26 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Volume dfb4b992-1508-49bf-8743-22cdcbfd934c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dfb4b992-1508-49bf-8743-22cdcbfd934c', 'volume_size': 2, 'snapshot_id': 'f898562a-2c7d-4168-9897-22bd33beb6b5'}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "cinder-quobyte-f898562a-2c7d-4168-9897-22bd33beb6b5-dfb4b992-1508-49bf-8743-22cdcbfd934c" by "_create_volume_from_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-f898562a-2c7d-4168-9897-22bd33beb6b5-dfb4b992-1508-49bf-8743-22cdcbfd934c" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Creating volume dfb4b992-1508-49bf-8743-22cdcbfd934c from snapshot f898562a-2c7d-4168-9897-22bd33beb6b5 {{(pid=80839) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "cinder-quobyte-dfb4b992-1508-49bf-8743-22cdcbfd934c" by "_copy_volume_from_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-dfb4b992-1508-49bf-8743-22cdcbfd934c" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] snapshot: f898562a-2c7d-4168-9897-22bd33beb6b5, volume: dfb4b992-1508-49bf-8743-22cdcbfd934c,  {{(pid=80839) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:392}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb9bf74-1862-42d3-a41b-015da39862c1]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:16:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.f898562a-2c7d-4168-9897-22bd33beb6b5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:26 devstack sudo[101239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.f898562a-2c7d-4168-9897-22bd33beb6b5
Nov 19 13:16:26 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:27 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.f898562a-2c7d-4168-9897-22bd33beb6b5" returned: 0 in 0.511s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:27 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15d465cd-1c62-4480-af6f-34a566d1fc43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:16:27 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43 {{(pid=80839) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:411}}
Nov 19 13:16:27 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Creating direct copy from snapshot {{(pid=80839) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:419}}
Nov 19 13:16:27 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b899f4-de01-4439-bc20-a64ffbbf1e1e]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:16:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:27 devstack sudo[101244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43
Nov 19 13:16:27 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:27 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43" returned: 0 in 0.520s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:27 devstack cinder-volume[80839]: DEBUG cinder.utils [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Path /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfb4b992-1508-49bf-8743-22cdcbfd934c not found in is_blk_device check {{(pid=80839) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Nov 19 13:16:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfb4b992-1508-49bf-8743-22cdcbfd934c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:27 devstack sudo[101249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfb4b992-1508-49bf-8743-22cdcbfd934c
Nov 19 13:16:27 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:29 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfb4b992-1508-49bf-8743-22cdcbfd934c" returned: 0 in 1.820s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:29 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48b679d-76f8-4dda-b96b-7bb15388289a]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:16:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:29 devstack sudo[101261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43
Nov 19 13:16:29 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:30 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43" returned: 0 in 0.628s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:30 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Image conversion details: src /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43, size 1024.00 MB, duration 1.82 sec, destination /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfb4b992-1508-49bf-8743-22cdcbfd934c {{(pid=80839) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 19 13:16:30 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Converted 1024.00 MB image at 562.02 MB/s
Nov 19 13:16:30 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfb4b992-1508-49bf-8743-22cdcbfd934c is being set with open permissions: ugo+rw
Nov 19 13:16:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfb4b992-1508-49bf-8743-22cdcbfd934c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:30 devstack sudo[101266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfb4b992-1508-49bf-8743-22cdcbfd934c
Nov 19 13:16:30 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:30 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfb4b992-1508-49bf-8743-22cdcbfd934c" returned: 0 in 0.415s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-dfb4b992-1508-49bf-8743-22cdcbfd934c" released by "_copy_volume_from_snapshot" :: held 3.950s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:16:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-f898562a-2c7d-4168-9897-22bd33beb6b5-dfb4b992-1508-49bf-8743-22cdcbfd934c" released by "_create_volume_from_snapshot" :: held 3.964s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:16:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.972s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:16:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae18267-5ca2-4c4b-9061-e6e1109daade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfb4b992-1508-49bf-8743-22cdcbfd934c', 'volume_size': 2, 'snapshot_id': 'f898562a-2c7d-4168-9897-22bd33beb6b5'}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bedf1b0-53b1-410a-be9b-27d72861dc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:30 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Volume volume-dfb4b992-1508-49bf-8743-22cdcbfd934c (dfb4b992-1508-49bf-8743-22cdcbfd934c): created successfully
Nov 19 13:16:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bedf1b0-53b1-410a-be9b-27d72861dc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Flow 'volume_create_manager' (e30d1058-1722-4c22-b267-688a07cbd230) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:16:30 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-a8510aee-2414-4dbe-aced-655be35ddb83 tempest-VolumesSnapshotTestJSON-621435841 None] Created volume successfully.
Nov 19 13:16:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-733d29a1-7e50-4790-97c5-6486eafba451 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "cinder-dfb4b992-1508-49bf-8743-22cdcbfd934c-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:16:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-733d29a1-7e50-4790-97c5-6486eafba451 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-dfb4b992-1508-49bf-8743-22cdcbfd934c-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:16:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-733d29a1-7e50-4790-97c5-6486eafba451 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "cinder-quobyte-dfb4b992-1508-49bf-8743-22cdcbfd934c" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:16:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-733d29a1-7e50-4790-97c5-6486eafba451 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-dfb4b992-1508-49bf-8743-22cdcbfd934c" acquired by "delete_volume" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:16:30 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[675b1bc0-34e7-44e2-a47d-2291e53d8aa7]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:16:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-733d29a1-7e50-4790-97c5-6486eafba451 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfb4b992-1508-49bf-8743-22cdcbfd934c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:31 devstack sudo[101269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfb4b992-1508-49bf-8743-22cdcbfd934c
Nov 19 13:16:31 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:31 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-733d29a1-7e50-4790-97c5-6486eafba451 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfb4b992-1508-49bf-8743-22cdcbfd934c" returned: 0 in 0.508s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-733d29a1-7e50-4790-97c5-6486eafba451 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfb4b992-1508-49bf-8743-22cdcbfd934c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:31 devstack sudo[101274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfb4b992-1508-49bf-8743-22cdcbfd934c
Nov 19 13:16:31 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:31 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-733d29a1-7e50-4790-97c5-6486eafba451 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-dfb4b992-1508-49bf-8743-22cdcbfd934c" returned: 0 in 0.412s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:31 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-733d29a1-7e50-4790-97c5-6486eafba451 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-dfb4b992-1508-49bf-8743-22cdcbfd934c" released by "delete_volume" :: held 0.949s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:16:31 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-733d29a1-7e50-4790-97c5-6486eafba451 tempest-VolumesSnapshotTestJSON-621435841 None] Created reservations ['83b2bfa6-18f4-428d-92fe-ae41f05d8d34', '617066e0-e3bf-4266-b174-2a8ce3723c3d', 'c449731a-dfee-4ba0-a372-cdef790da567', 'd204d14e-11fe-4824-9708-97a0f35a565a'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:16:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-733d29a1-7e50-4790-97c5-6486eafba451 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:16:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-733d29a1-7e50-4790-97c5-6486eafba451 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:16:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-733d29a1-7e50-4790-97c5-6486eafba451 tempest-VolumesSnapshotTestJSON-621435841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:16:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-733d29a1-7e50-4790-97c5-6486eafba451 tempest-VolumesSnapshotTestJSON-621435841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:16:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-733d29a1-7e50-4790-97c5-6486eafba451 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:16:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-733d29a1-7e50-4790-97c5-6486eafba451 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:31 devstack sudo[101277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:16:31 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:32 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-962a777e-0fb6-40c7-b396-22b3445a929c tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "cinder-f898562a-2c7d-4168-9897-22bd33beb6b5-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:16:32 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-962a777e-0fb6-40c7-b396-22b3445a929c tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-f898562a-2c7d-4168-9897-22bd33beb6b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:16:32 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-962a777e-0fb6-40c7-b396-22b3445a929c tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "cinder-quobyte-15d465cd-1c62-4480-af6f-34a566d1fc43" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:16:32 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-962a777e-0fb6-40c7-b396-22b3445a929c tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-15d465cd-1c62-4480-af6f-34a566d1fc43" acquired by "delete_snapshot" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:16:32 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-962a777e-0fb6-40c7-b396-22b3445a929c tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "cinder-quobyte-f898562a-2c7d-4168-9897-22bd33beb6b5" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:16:32 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-962a777e-0fb6-40c7-b396-22b3445a929c tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-f898562a-2c7d-4168-9897-22bd33beb6b5" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:16:32 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-962a777e-0fb6-40c7-b396-22b3445a929c tempest-VolumesSnapshotTestJSON-621435841 None] Deleting offline snapshot f898562a-2c7d-4168-9897-22bd33beb6b5 of volume 15d465cd-1c62-4480-af6f-34a566d1fc43 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 13:16:32 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-962a777e-0fb6-40c7-b396-22b3445a929c tempest-VolumesSnapshotTestJSON-621435841 None] snapshot_file for this snap is: volume-15d465cd-1c62-4480-af6f-34a566d1fc43.f898562a-2c7d-4168-9897-22bd33beb6b5 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 13:16:32 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2d7ec7-10ac-4a59-bdcf-990a829442a8]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:16:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-962a777e-0fb6-40c7-b396-22b3445a929c tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.f898562a-2c7d-4168-9897-22bd33beb6b5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:32 devstack sudo[101279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.f898562a-2c7d-4168-9897-22bd33beb6b5
Nov 19 13:16:32 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:32 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-733d29a1-7e50-4790-97c5-6486eafba451 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.433s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:32 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-733d29a1-7e50-4790-97c5-6486eafba451 tempest-VolumesSnapshotTestJSON-621435841 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:16:32 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-733d29a1-7e50-4790-97c5-6486eafba451 tempest-VolumesSnapshotTestJSON-621435841 None] Deleted volume successfully.
Nov 19 13:16:32 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-733d29a1-7e50-4790-97c5-6486eafba451 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-dfb4b992-1508-49bf-8743-22cdcbfd934c-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:16:32 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-962a777e-0fb6-40c7-b396-22b3445a929c tempest-VolumesSnapshotTestJSON-621435841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.f898562a-2c7d-4168-9897-22bd33beb6b5" returned: 0 in 0.515s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:32 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-962a777e-0fb6-40c7-b396-22b3445a929c tempest-VolumesSnapshotTestJSON-621435841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15d465cd-1c62-4480-af6f-34a566d1fc43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:16:32 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f3246a-c0ea-47e8-8e7e-60544f8e5f35]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:16:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-962a777e-0fb6-40c7-b396-22b3445a929c tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:32 devstack sudo[101285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43
Nov 19 13:16:32 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:33 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-962a777e-0fb6-40c7-b396-22b3445a929c tempest-VolumesSnapshotTestJSON-621435841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43" returned: 0 in 0.526s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-962a777e-0fb6-40c7-b396-22b3445a929c tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.f898562a-2c7d-4168-9897-22bd33beb6b5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:33 devstack sudo[101291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.f898562a-2c7d-4168-9897-22bd33beb6b5
Nov 19 13:16:33 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:33 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-962a777e-0fb6-40c7-b396-22b3445a929c tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.f898562a-2c7d-4168-9897-22bd33beb6b5" returned: 0 in 0.448s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-962a777e-0fb6-40c7-b396-22b3445a929c tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.f898562a-2c7d-4168-9897-22bd33beb6b5 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:33 devstack sudo[101296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.f898562a-2c7d-4168-9897-22bd33beb6b5
Nov 19 13:16:33 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:34 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-962a777e-0fb6-40c7-b396-22b3445a929c tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43.f898562a-2c7d-4168-9897-22bd33beb6b5" returned: 0 in 0.424s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:34 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-962a777e-0fb6-40c7-b396-22b3445a929c tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-f898562a-2c7d-4168-9897-22bd33beb6b5" released by "_delete_snapshot" :: held 1.968s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:16:34 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-962a777e-0fb6-40c7-b396-22b3445a929c tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-15d465cd-1c62-4480-af6f-34a566d1fc43" released by "delete_snapshot" :: held 1.977s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:16:34 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-962a777e-0fb6-40c7-b396-22b3445a929c tempest-VolumesSnapshotTestJSON-621435841 None] Created reservations ['9e7295cc-9e93-4a10-92ef-c612b6c4094d', 'bbe4dfa8-55f6-4f53-9c5c-b0235a5a555d', 'd86084e6-ffc1-4922-bfd1-e11278647fc8', 'b8abe430-450d-4f06-8c1b-7aa1e40e6b90'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:16:34 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-962a777e-0fb6-40c7-b396-22b3445a929c tempest-VolumesSnapshotTestJSON-621435841 None] Delete snapshot completed successfully.
Nov 19 13:16:34 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-962a777e-0fb6-40c7-b396-22b3445a929c tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-f898562a-2c7d-4168-9897-22bd33beb6b5-delete_snapshot" released by "delete_snapshot" :: held 2.057s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:16:34 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-26637cd8-988f-4027-8496-559548f16899 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "cinder-15d465cd-1c62-4480-af6f-34a566d1fc43-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:16:34 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-26637cd8-988f-4027-8496-559548f16899 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-15d465cd-1c62-4480-af6f-34a566d1fc43-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:16:34 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-26637cd8-988f-4027-8496-559548f16899 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "cinder-quobyte-15d465cd-1c62-4480-af6f-34a566d1fc43" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:16:34 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-26637cd8-988f-4027-8496-559548f16899 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-15d465cd-1c62-4480-af6f-34a566d1fc43" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:16:34 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb00fd8-3a40-4243-a3c9-8bd0c806c558]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:16:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-26637cd8-988f-4027-8496-559548f16899 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:34 devstack sudo[101299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43
Nov 19 13:16:34 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:34 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-26637cd8-988f-4027-8496-559548f16899 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43" returned: 0 in 0.522s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-26637cd8-988f-4027-8496-559548f16899 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:34 devstack sudo[101304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43
Nov 19 13:16:34 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:35 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-26637cd8-988f-4027-8496-559548f16899 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-15d465cd-1c62-4480-af6f-34a566d1fc43" returned: 0 in 0.406s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-26637cd8-988f-4027-8496-559548f16899 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-15d465cd-1c62-4480-af6f-34a566d1fc43" released by "delete_volume" :: held 0.954s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-26637cd8-988f-4027-8496-559548f16899 tempest-VolumesSnapshotTestJSON-621435841 None] Created reservations ['76b74697-041e-4af8-95e6-4012e6e4f82f', 'c911d277-f422-49dc-be04-544312205850', '673b5b97-37df-4711-9c74-50ce073ad729', '888b18f9-e39a-4928-ad4c-0d1ba995210f'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-26637cd8-988f-4027-8496-559548f16899 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-26637cd8-988f-4027-8496-559548f16899 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-26637cd8-988f-4027-8496-559548f16899 tempest-VolumesSnapshotTestJSON-621435841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-26637cd8-988f-4027-8496-559548f16899 tempest-VolumesSnapshotTestJSON-621435841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-26637cd8-988f-4027-8496-559548f16899 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-26637cd8-988f-4027-8496-559548f16899 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:35 devstack sudo[101307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:16:35 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Flow 'volume_create_manager' (163f839e-6ace-4bbd-984d-1536a9186fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb20b88-62cf-4212-b9a1-b7b990244adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb20b88-62cf-4212-b9a1-b7b990244adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1902673034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d9c25d-d666-4a6b-840d-2d90a0cbabd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f9bd30cd1441659ec2379aefb3f9f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:16:36Z,use_quota=True,user_id='333d23e5cb4b4014942b5640df7ad31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791c3d97-da4f-4499-af34-f16ec39a9542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791c3d97-da4f-4499-af34-f16ec39a9542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d2cd374-e47a-4602-b1cb-30cc56236c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d2cd374-e47a-4602-b1cb-30cc56236c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2d9c25d-d666-4a6b-840d-2d90a0cbabd3', 'volume_name': 'volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def8c223-7d42-4b2d-8619-3d2c43dd6a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def8c223-7d42-4b2d-8619-3d2c43dd6a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52529ad-3891-42bf-8f14-d43f77a15cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:35 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Volume d2d9c25d-d666-4a6b-840d-2d90a0cbabd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3', 'volume_size': 1}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1902673034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d9c25d-d666-4a6b-840d-2d90a0cbabd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f9bd30cd1441659ec2379aefb3f9f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:16:36Z,use_quota=True,user_id='333d23e5cb4b4014942b5640df7ad31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Creating volume d2d9c25d-d666-4a6b-840d-2d90a0cbabd3 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:16:35 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:35 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-26637cd8-988f-4027-8496-559548f16899 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.444s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-26637cd8-988f-4027-8496-559548f16899 tempest-VolumesSnapshotTestJSON-621435841 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:16:35 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-26637cd8-988f-4027-8496-559548f16899 tempest-VolumesSnapshotTestJSON-621435841 None] Deleted volume successfully.
Nov 19 13:16:35 devstack sudo[101316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3 1073741824
Nov 19 13:16:35 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:35 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-26637cd8-988f-4027-8496-559548f16899 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-15d465cd-1c62-4480-af6f-34a566d1fc43-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:16:36 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3 1073741824" returned: 0 in 0.496s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:36 devstack sudo[101321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3
Nov 19 13:16:36 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:36 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3" returned: 0 in 0.412s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:36 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:16:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:16:36 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52529ad-3891-42bf-8f14-d43f77a15cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:36 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a5bf09-52f9-497e-bba2-2605539babfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:36 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Volume volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3 (d2d9c25d-d666-4a6b-840d-2d90a0cbabd3): created successfully
Nov 19 13:16:36 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a5bf09-52f9-497e-bba2-2605539babfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:36 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Flow 'volume_create_manager' (163f839e-6ace-4bbd-984d-1536a9186fbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:16:36 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-2050352e-66cf-4f30-a87a-2173c35e867e tempest-VolumesSnapshotTestJSON-621435841 None] Created volume successfully.
Nov 19 13:16:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1810c2e7-000e-4199-8302-77d0ecb94e72 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:16:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1810c2e7-000e-4199-8302-77d0ecb94e72 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:16:37 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-1810c2e7-000e-4199-8302-77d0ecb94e72 tempest-VolumesSnapshotTestJSON-621435841 None] Creating offline snapshot 46da7003-54c6-4e05-bca7-5c01c927c567 of volume d2d9c25d-d666-4a6b-840d-2d90a0cbabd3 {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 13:16:37 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[345c7852-7b72-4e68-b52e-bc1a9f62e945]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:16:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1810c2e7-000e-4199-8302-77d0ecb94e72 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:37 devstack sudo[101358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3
Nov 19 13:16:37 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:38 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1810c2e7-000e-4199-8302-77d0ecb94e72 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3" returned: 0 in 0.507s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1810c2e7-000e-4199-8302-77d0ecb94e72 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.46da7003-54c6-4e05-bca7-5c01c927c567 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:38 devstack sudo[101363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.46da7003-54c6-4e05-bca7-5c01c927c567 1G
Nov 19 13:16:38 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:38 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1810c2e7-000e-4199-8302-77d0ecb94e72 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.46da7003-54c6-4e05-bca7-5c01c927c567 1G" returned: 0 in 0.467s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1810c2e7-000e-4199-8302-77d0ecb94e72 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.46da7003-54c6-4e05-bca7-5c01c927c567 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:38 devstack sudo[101368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.46da7003-54c6-4e05-bca7-5c01c927c567
Nov 19 13:16:38 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:39 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1810c2e7-000e-4199-8302-77d0ecb94e72 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.46da7003-54c6-4e05-bca7-5c01c927c567" returned: 0 in 0.437s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:39 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-1810c2e7-000e-4199-8302-77d0ecb94e72 tempest-VolumesSnapshotTestJSON-621435841 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.46da7003-54c6-4e05-bca7-5c01c927c567 is being set with open permissions: ugo+rw
Nov 19 13:16:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1810c2e7-000e-4199-8302-77d0ecb94e72 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.46da7003-54c6-4e05-bca7-5c01c927c567 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:39 devstack sudo[101373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.46da7003-54c6-4e05-bca7-5c01c927c567
Nov 19 13:16:39 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:39 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1810c2e7-000e-4199-8302-77d0ecb94e72 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.46da7003-54c6-4e05-bca7-5c01c927c567" returned: 0 in 0.409s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1810c2e7-000e-4199-8302-77d0ecb94e72 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:39 devstack sudo[101376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.info
Nov 19 13:16:39 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:40 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1810c2e7-000e-4199-8302-77d0ecb94e72 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.info" returned: 0 in 0.412s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:40 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-1810c2e7-000e-4199-8302-77d0ecb94e72 tempest-VolumesSnapshotTestJSON-621435841 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.info is being set with open permissions: ugo+rw
Nov 19 13:16:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1810c2e7-000e-4199-8302-77d0ecb94e72 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:40 devstack sudo[101379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.info
Nov 19 13:16:40 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:40 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1810c2e7-000e-4199-8302-77d0ecb94e72 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.info" returned: 0 in 0.415s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1810c2e7-000e-4199-8302-77d0ecb94e72 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.685s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:16:40 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-1810c2e7-000e-4199-8302-77d0ecb94e72 tempest-VolumesSnapshotTestJSON-621435841 None] Create snapshot completed successfully
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Flow 'volume_create_manager' (c994f516-7b9e-4218-880a-3b1645633351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d10596-03e5-4b42-bc6c-2664331d8256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d10596-03e5-4b42-bc6c-2664331d8256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-934793747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f9bd30cd1441659ec2379aefb3f9f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=46da7003-54c6-4e05-bca7-5c01c927c567,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:16:41Z,use_quota=True,user_id='333d23e5cb4b4014942b5640df7ad31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2ec35d3-0e11-4574-8035-4ae516790783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2ec35d3-0e11-4574-8035-4ae516790783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (834d3e88-6aa8-497b-a43e-7b51bcf05f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (834d3e88-6aa8-497b-a43e-7b51bcf05f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f', 'volume_name': 'volume-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f', 'volume_size': 1, 'snapshot_id': '46da7003-54c6-4e05-bca7-5c01c927c567'}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f8320ea-cb4c-46d5-9cf8-d5a6b97bba84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f8320ea-cb4c-46d5-9cf8-d5a6b97bba84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141fe19f-1de7-417e-bc9f-c1ea031c6245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:41 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Volume ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f', 'volume_size': 1, 'snapshot_id': '46da7003-54c6-4e05-bca7-5c01c927c567'}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "cinder-quobyte-46da7003-54c6-4e05-bca7-5c01c927c567-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f" by "_create_volume_from_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-46da7003-54c6-4e05-bca7-5c01c927c567-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Creating volume ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f from snapshot 46da7003-54c6-4e05-bca7-5c01c927c567 {{(pid=80839) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "cinder-quobyte-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f" by "_copy_volume_from_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f" acquired by "_copy_volume_from_snapshot" :: waited 0.005s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] snapshot: 46da7003-54c6-4e05-bca7-5c01c927c567, volume: ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f,  {{(pid=80839) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:392}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[780e53f1-0422-4223-85c9-38a6d98f74b7]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.46da7003-54c6-4e05-bca7-5c01c927c567 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:41 devstack sudo[101382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.46da7003-54c6-4e05-bca7-5c01c927c567
Nov 19 13:16:41 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:41 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.46da7003-54c6-4e05-bca7-5c01c927c567" returned: 0 in 0.528s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3 {{(pid=80839) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:411}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Creating direct copy from snapshot {{(pid=80839) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:419}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[953ba4eb-8fbf-476e-aee6-2348b373da12]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:16:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:41 devstack sudo[101388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3
Nov 19 13:16:41 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:42 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3" returned: 0 in 0.518s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:42 devstack cinder-volume[80839]: DEBUG cinder.utils [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Path /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f not found in is_blk_device check {{(pid=80839) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Nov 19 13:16:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:42 devstack sudo[101393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f
Nov 19 13:16:42 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:44 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f" returned: 0 in 1.938s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:44 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd513dd8-337a-4f4a-92d6-1abaf9778d0e]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:16:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:44 devstack sudo[101406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3
Nov 19 13:16:44 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:44 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3" returned: 0 in 0.642s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:44 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Image conversion details: src /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3, size 1024.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f {{(pid=80839) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 19 13:16:44 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Converted 1024.00 MB image at 528.09 MB/s
Nov 19 13:16:44 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f is being set with open permissions: ugo+rw
Nov 19 13:16:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:44 devstack sudo[101411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f
Nov 19 13:16:44 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:45 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f" returned: 0 in 0.419s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:45 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f" released by "_copy_volume_from_snapshot" :: held 4.100s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:16:45 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-46da7003-54c6-4e05-bca7-5c01c927c567-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f" released by "_create_volume_from_snapshot" :: held 4.114s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:16:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.122s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:16:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141fe19f-1de7-417e-bc9f-c1ea031c6245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f', 'volume_size': 1, 'snapshot_id': '46da7003-54c6-4e05-bca7-5c01c927c567'}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efe5ccf8-ef7f-41ce-a596-19bded995dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:45 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Volume volume-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f (ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f): created successfully
Nov 19 13:16:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efe5ccf8-ef7f-41ce-a596-19bded995dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Flow 'volume_create_manager' (c994f516-7b9e-4218-880a-3b1645633351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:16:45 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-a25d592b-d419-45f4-8726-ac8c0de51fe1 tempest-VolumesSnapshotTestJSON-621435841 None] Created volume successfully.
Nov 19 13:16:46 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-ff210b74-b3a2-43a7-9f36-90280e5b08f9 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "cinder-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:16:46 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-ff210b74-b3a2-43a7-9f36-90280e5b08f9 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:16:46 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-ff210b74-b3a2-43a7-9f36-90280e5b08f9 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "cinder-quobyte-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:16:46 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-ff210b74-b3a2-43a7-9f36-90280e5b08f9 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f" acquired by "delete_volume" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:16:46 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[942c8cd6-aa08-4ab2-95f4-228c4c0cba92]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:16:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ff210b74-b3a2-43a7-9f36-90280e5b08f9 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:46 devstack sudo[101414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f
Nov 19 13:16:46 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:47 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ff210b74-b3a2-43a7-9f36-90280e5b08f9 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f" returned: 0 in 0.521s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ff210b74-b3a2-43a7-9f36-90280e5b08f9 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:47 devstack sudo[101419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f
Nov 19 13:16:47 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:47 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ff210b74-b3a2-43a7-9f36-90280e5b08f9 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f" returned: 0 in 0.415s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:47 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-ff210b74-b3a2-43a7-9f36-90280e5b08f9 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f" released by "delete_volume" :: held 0.971s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:16:47 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-ff210b74-b3a2-43a7-9f36-90280e5b08f9 tempest-VolumesSnapshotTestJSON-621435841 None] Created reservations ['c12c8ee0-daf2-41a0-a2c5-b7cdbf526fb3', '237a02bd-81eb-456a-81da-1e72ffe44367', '260194b7-f62c-491a-aafb-1c189e156f2d', '9e26a213-e323-4805-9f11-0e1956655b87'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:16:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ff210b74-b3a2-43a7-9f36-90280e5b08f9 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:16:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ff210b74-b3a2-43a7-9f36-90280e5b08f9 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:16:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ff210b74-b3a2-43a7-9f36-90280e5b08f9 tempest-VolumesSnapshotTestJSON-621435841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:16:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ff210b74-b3a2-43a7-9f36-90280e5b08f9 tempest-VolumesSnapshotTestJSON-621435841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:16:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ff210b74-b3a2-43a7-9f36-90280e5b08f9 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:16:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ff210b74-b3a2-43a7-9f36-90280e5b08f9 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:47 devstack sudo[101422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:16:47 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:47 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-da0ddbbd-f690-40a3-bd22-4867f328b3c5 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "cinder-46da7003-54c6-4e05-bca7-5c01c927c567-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:16:47 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-da0ddbbd-f690-40a3-bd22-4867f328b3c5 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-46da7003-54c6-4e05-bca7-5c01c927c567-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:16:47 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-da0ddbbd-f690-40a3-bd22-4867f328b3c5 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "cinder-quobyte-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:16:47 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-da0ddbbd-f690-40a3-bd22-4867f328b3c5 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3" acquired by "delete_snapshot" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:16:47 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-da0ddbbd-f690-40a3-bd22-4867f328b3c5 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "cinder-quobyte-46da7003-54c6-4e05-bca7-5c01c927c567" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:16:47 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-da0ddbbd-f690-40a3-bd22-4867f328b3c5 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-46da7003-54c6-4e05-bca7-5c01c927c567" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:16:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-da0ddbbd-f690-40a3-bd22-4867f328b3c5 tempest-VolumesSnapshotTestJSON-621435841 None] Deleting offline snapshot 46da7003-54c6-4e05-bca7-5c01c927c567 of volume d2d9c25d-d666-4a6b-840d-2d90a0cbabd3 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 13:16:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-da0ddbbd-f690-40a3-bd22-4867f328b3c5 tempest-VolumesSnapshotTestJSON-621435841 None] snapshot_file for this snap is: volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.46da7003-54c6-4e05-bca7-5c01c927c567 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 13:16:47 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[949f8946-5641-4083-acea-89b4eb5b3b29]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:16:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-da0ddbbd-f690-40a3-bd22-4867f328b3c5 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.46da7003-54c6-4e05-bca7-5c01c927c567 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:47 devstack sudo[101424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.46da7003-54c6-4e05-bca7-5c01c927c567
Nov 19 13:16:47 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:48 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ff210b74-b3a2-43a7-9f36-90280e5b08f9 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.437s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:48 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-ff210b74-b3a2-43a7-9f36-90280e5b08f9 tempest-VolumesSnapshotTestJSON-621435841 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:16:48 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-ff210b74-b3a2-43a7-9f36-90280e5b08f9 tempest-VolumesSnapshotTestJSON-621435841 None] Deleted volume successfully.
Nov 19 13:16:48 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-ff210b74-b3a2-43a7-9f36-90280e5b08f9 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-ccd45fdc-f999-4892-a2a4-f8ef6caf0e5f-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:16:48 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-da0ddbbd-f690-40a3-bd22-4867f328b3c5 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.46da7003-54c6-4e05-bca7-5c01c927c567" returned: 0 in 0.532s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:48 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-da0ddbbd-f690-40a3-bd22-4867f328b3c5 tempest-VolumesSnapshotTestJSON-621435841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:16:48 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcee8cd-61ea-4239-8608-3e8df7f5497a]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:16:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-da0ddbbd-f690-40a3-bd22-4867f328b3c5 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:48 devstack sudo[101430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3
Nov 19 13:16:48 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:48 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-da0ddbbd-f690-40a3-bd22-4867f328b3c5 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3" returned: 0 in 0.530s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-da0ddbbd-f690-40a3-bd22-4867f328b3c5 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.46da7003-54c6-4e05-bca7-5c01c927c567 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:48 devstack sudo[101435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.46da7003-54c6-4e05-bca7-5c01c927c567
Nov 19 13:16:48 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:49 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-da0ddbbd-f690-40a3-bd22-4867f328b3c5 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.46da7003-54c6-4e05-bca7-5c01c927c567" returned: 0 in 0.450s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-da0ddbbd-f690-40a3-bd22-4867f328b3c5 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.46da7003-54c6-4e05-bca7-5c01c927c567 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:49 devstack sudo[101440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.46da7003-54c6-4e05-bca7-5c01c927c567
Nov 19 13:16:49 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:49 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-da0ddbbd-f690-40a3-bd22-4867f328b3c5 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3.46da7003-54c6-4e05-bca7-5c01c927c567" returned: 0 in 0.413s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:49 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-da0ddbbd-f690-40a3-bd22-4867f328b3c5 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-46da7003-54c6-4e05-bca7-5c01c927c567" released by "_delete_snapshot" :: held 1.981s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:16:49 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-da0ddbbd-f690-40a3-bd22-4867f328b3c5 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3" released by "delete_snapshot" :: held 1.996s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:16:49 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-da0ddbbd-f690-40a3-bd22-4867f328b3c5 tempest-VolumesSnapshotTestJSON-621435841 None] Created reservations ['7da18744-1820-442c-8350-7e0f07dc9697', 'f3a5bb1b-487d-4d69-9277-02321b9093ae', 'ea93222a-7534-4872-a5d6-d80755c493fd', 'd72b161d-fdcf-4409-a17a-c6d75061cd52'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:16:49 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-da0ddbbd-f690-40a3-bd22-4867f328b3c5 tempest-VolumesSnapshotTestJSON-621435841 None] Delete snapshot completed successfully.
Nov 19 13:16:49 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-da0ddbbd-f690-40a3-bd22-4867f328b3c5 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-46da7003-54c6-4e05-bca7-5c01c927c567-delete_snapshot" released by "delete_snapshot" :: held 2.076s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:16:49 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-4226fba6-41dd-4891-9de6-82c1b4e51a66 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "cinder-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:16:49 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-4226fba6-41dd-4891-9de6-82c1b4e51a66 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:16:49 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-4226fba6-41dd-4891-9de6-82c1b4e51a66 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "cinder-quobyte-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:16:49 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-4226fba6-41dd-4891-9de6-82c1b4e51a66 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3" acquired by "delete_volume" :: waited 0.006s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:16:49 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c02fb4-257b-40ed-8922-c532c53dde35]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:16:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4226fba6-41dd-4891-9de6-82c1b4e51a66 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:50 devstack sudo[101443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3
Nov 19 13:16:50 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:50 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4226fba6-41dd-4891-9de6-82c1b4e51a66 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3" returned: 0 in 0.509s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4226fba6-41dd-4891-9de6-82c1b4e51a66 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:50 devstack sudo[101448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3
Nov 19 13:16:50 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:50 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4226fba6-41dd-4891-9de6-82c1b4e51a66 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3" returned: 0 in 0.406s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:50 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-4226fba6-41dd-4891-9de6-82c1b4e51a66 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3" released by "delete_volume" :: held 0.954s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:16:50 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-4226fba6-41dd-4891-9de6-82c1b4e51a66 tempest-VolumesSnapshotTestJSON-621435841 None] Created reservations ['e2b9c844-53d3-47dd-8a5e-b9be27196c9d', 'd7bbdbec-69ac-4df3-9a98-40e4bd30858a', '0e16926a-151e-48e2-8fa4-56153141df16', 'c54224d1-64fe-4391-8826-07a382624f42'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:16:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4226fba6-41dd-4891-9de6-82c1b4e51a66 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:16:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4226fba6-41dd-4891-9de6-82c1b4e51a66 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:16:50 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4226fba6-41dd-4891-9de6-82c1b4e51a66 tempest-VolumesSnapshotTestJSON-621435841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:16:50 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-4226fba6-41dd-4891-9de6-82c1b4e51a66 tempest-VolumesSnapshotTestJSON-621435841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:16:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-4226fba6-41dd-4891-9de6-82c1b4e51a66 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:16:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4226fba6-41dd-4891-9de6-82c1b4e51a66 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:50 devstack sudo[101451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:16:50 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:51 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-28d66c1e-d7c8-4402-85e4-a1bb65fdd699 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "cinder-a7057b59-41f6-474c-9fc3-01b6af0f7b14-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:16:51 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-28d66c1e-d7c8-4402-85e4-a1bb65fdd699 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-a7057b59-41f6-474c-9fc3-01b6af0f7b14-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:16:51 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-28d66c1e-d7c8-4402-85e4-a1bb65fdd699 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "cinder-quobyte-a7057b59-41f6-474c-9fc3-01b6af0f7b14" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:16:51 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-28d66c1e-d7c8-4402-85e4-a1bb65fdd699 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-a7057b59-41f6-474c-9fc3-01b6af0f7b14" acquired by "delete_volume" :: waited 0.018s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:16:51 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[765b6c3d-4bd5-43ce-a04f-a526af316a35]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:16:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-28d66c1e-d7c8-4402-85e4-a1bb65fdd699 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:51 devstack sudo[101453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14
Nov 19 13:16:51 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:51 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-4226fba6-41dd-4891-9de6-82c1b4e51a66 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.438s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:51 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-4226fba6-41dd-4891-9de6-82c1b4e51a66 tempest-VolumesSnapshotTestJSON-621435841 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:16:51 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-4226fba6-41dd-4891-9de6-82c1b4e51a66 tempest-VolumesSnapshotTestJSON-621435841 None] Deleted volume successfully.
Nov 19 13:16:51 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-4226fba6-41dd-4891-9de6-82c1b4e51a66 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-d2d9c25d-d666-4a6b-840d-2d90a0cbabd3-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:16:51 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-28d66c1e-d7c8-4402-85e4-a1bb65fdd699 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14" returned: 0 in 0.521s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-28d66c1e-d7c8-4402-85e4-a1bb65fdd699 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:51 devstack sudo[101459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14
Nov 19 13:16:51 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:52 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-28d66c1e-d7c8-4402-85e4-a1bb65fdd699 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a7057b59-41f6-474c-9fc3-01b6af0f7b14" returned: 0 in 0.403s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:52 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-28d66c1e-d7c8-4402-85e4-a1bb65fdd699 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-quobyte-a7057b59-41f6-474c-9fc3-01b6af0f7b14" released by "delete_volume" :: held 0.949s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:16:52 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-28d66c1e-d7c8-4402-85e4-a1bb65fdd699 tempest-VolumesSnapshotTestJSON-621435841 None] Created reservations ['fea60745-3374-40ea-a711-26195c9fbb43', '31254103-5044-45fe-8a52-4cc3a463742e', '0949aab4-7182-4d57-b2db-ad109afa0386', '2d57d93e-c53b-42fa-aa98-207605f9f723'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:16:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-28d66c1e-d7c8-4402-85e4-a1bb65fdd699 tempest-VolumesSnapshotTestJSON-621435841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:16:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-28d66c1e-d7c8-4402-85e4-a1bb65fdd699 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:16:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-28d66c1e-d7c8-4402-85e4-a1bb65fdd699 tempest-VolumesSnapshotTestJSON-621435841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:16:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-28d66c1e-d7c8-4402-85e4-a1bb65fdd699 tempest-VolumesSnapshotTestJSON-621435841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:16:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-28d66c1e-d7c8-4402-85e4-a1bb65fdd699 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:16:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-28d66c1e-d7c8-4402-85e4-a1bb65fdd699 tempest-VolumesSnapshotTestJSON-621435841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:52 devstack sudo[101462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:16:52 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:52 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-28d66c1e-d7c8-4402-85e4-a1bb65fdd699 tempest-VolumesSnapshotTestJSON-621435841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.431s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:52 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-28d66c1e-d7c8-4402-85e4-a1bb65fdd699 tempest-VolumesSnapshotTestJSON-621435841 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:16:52 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-28d66c1e-d7c8-4402-85e4-a1bb65fdd699 tempest-VolumesSnapshotTestJSON-621435841 None] Deleted volume successfully.
Nov 19 13:16:52 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-28d66c1e-d7c8-4402-85e4-a1bb65fdd699 tempest-VolumesSnapshotTestJSON-621435841 None] Lock "cinder-a7057b59-41f6-474c-9fc3-01b6af0f7b14-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:16:55 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:16:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Flow 'volume_create_manager' (4ae19e0b-c7fb-416e-9f49-109744fbe985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:16:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c8785c0-e003-4a52-99de-fc73c93f6dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c8785c0-e003-4a52-99de-fc73c93f6dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-292180339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6c7333-b000-41b2-816c-7211b59670a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='210f25a8d5b045f18a34c1b81c6e5fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:16:56Z,use_quota=True,user_id='3b8e318f9a0e45f79be9d2d543b7b0fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca19c1dd-1195-4470-b25c-85eef03523c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca19c1dd-1195-4470-b25c-85eef03523c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:55 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c71efdf-b780-469d-aaa4-9e95193adb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c71efdf-b780-469d-aaa4-9e95193adb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d6c7333-b000-41b2-816c-7211b59670a3', 'volume_name': 'volume-0d6c7333-b000-41b2-816c-7211b59670a3', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f99cd2-e240-4014-9a0f-54254341ecc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f99cd2-e240-4014-9a0f-54254341ecc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc0046a3-8b52-4a42-a351-a08fd681d5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:56 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Volume 0d6c7333-b000-41b2-816c-7211b59670a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d6c7333-b000-41b2-816c-7211b59670a3', 'volume_size': 1}
Nov 19 13:16:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:16:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:16:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-292180339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6c7333-b000-41b2-816c-7211b59670a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='210f25a8d5b045f18a34c1b81c6e5fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:16:56Z,use_quota=True,user_id='3b8e318f9a0e45f79be9d2d543b7b0fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:16:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Creating volume 0d6c7333-b000-41b2-816c-7211b59670a3 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:16:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:16:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:16:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:16:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:16:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:16:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:16:56 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:16:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:56 devstack sudo[101471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3 1073741824
Nov 19 13:16:56 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:56 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3 1073741824" returned: 0 in 0.505s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:56 devstack sudo[101476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3
Nov 19 13:16:56 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:56 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3" returned: 0 in 0.408s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:16:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:16:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc0046a3-8b52-4a42-a351-a08fd681d5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d6c7333-b000-41b2-816c-7211b59670a3', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cecacc5b-f8bf-4669-9f71-ba85a8382388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:16:56 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Volume volume-0d6c7333-b000-41b2-816c-7211b59670a3 (0d6c7333-b000-41b2-816c-7211b59670a3): created successfully
Nov 19 13:16:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cecacc5b-f8bf-4669-9f71-ba85a8382388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:16:56 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Flow 'volume_create_manager' (4ae19e0b-c7fb-416e-9f49-109744fbe985) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:16:56 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-2ba327c3-43f8-45e0-bb35-2f023b654063 tempest-VolumesSnapshotListTestJSON-1817796478 None] Created volume successfully.
Nov 19 13:16:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-739ff7bb-403d-4a9b-b2a2-cf9293067a77 tempest-VolumesSnapshotListTestJSON-1817796478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:16:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-739ff7bb-403d-4a9b-b2a2-cf9293067a77 tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:16:58 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-739ff7bb-403d-4a9b-b2a2-cf9293067a77 tempest-VolumesSnapshotListTestJSON-1817796478 None] Creating offline snapshot 6d2e8273-9454-4895-8858-1e0eaa951df9 of volume 0d6c7333-b000-41b2-816c-7211b59670a3 {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 13:16:58 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[348cff6a-f93b-4e45-9864-2a130637f2fc]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:16:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-739ff7bb-403d-4a9b-b2a2-cf9293067a77 tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:58 devstack sudo[101479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3
Nov 19 13:16:58 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:58 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-739ff7bb-403d-4a9b-b2a2-cf9293067a77 tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3" returned: 0 in 0.505s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-739ff7bb-403d-4a9b-b2a2-cf9293067a77 tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:58 devstack sudo[101484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9 1G
Nov 19 13:16:58 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:59 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-739ff7bb-403d-4a9b-b2a2-cf9293067a77 tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9 1G" returned: 0 in 0.469s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-739ff7bb-403d-4a9b-b2a2-cf9293067a77 tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6c7333-b000-41b2-816c-7211b59670a3 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:59 devstack sudo[101489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6c7333-b000-41b2-816c-7211b59670a3 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9
Nov 19 13:16:59 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:16:59 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root
Nov 19 13:16:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-739ff7bb-403d-4a9b-b2a2-cf9293067a77 tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6c7333-b000-41b2-816c-7211b59670a3 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9" returned: 0 in 0.451s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:16:59 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-739ff7bb-403d-4a9b-b2a2-cf9293067a77 tempest-VolumesSnapshotListTestJSON-1817796478 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9 is being set with open permissions: ugo+rw
Nov 19 13:16:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-739ff7bb-403d-4a9b-b2a2-cf9293067a77 tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:16:59 devstack sudo[101494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9
Nov 19 13:16:59 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:00 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-739ff7bb-403d-4a9b-b2a2-cf9293067a77 tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9" returned: 0 in 0.414s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-739ff7bb-403d-4a9b-b2a2-cf9293067a77 tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:00 devstack sudo[101497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.info
Nov 19 13:17:00 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:00 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-739ff7bb-403d-4a9b-b2a2-cf9293067a77 tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.info" returned: 0 in 0.421s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:00 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-739ff7bb-403d-4a9b-b2a2-cf9293067a77 tempest-VolumesSnapshotListTestJSON-1817796478 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.info is being set with open permissions: ugo+rw
Nov 19 13:17:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-739ff7bb-403d-4a9b-b2a2-cf9293067a77 tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:00 devstack sudo[101500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.info
Nov 19 13:17:00 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:00 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-739ff7bb-403d-4a9b-b2a2-cf9293067a77 tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.info" returned: 0 in 0.405s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-739ff7bb-403d-4a9b-b2a2-cf9293067a77 tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.702s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:00 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-739ff7bb-403d-4a9b-b2a2-cf9293067a77 tempest-VolumesSnapshotListTestJSON-1817796478 None] Create snapshot completed successfully
Nov 19 13:17:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e9a75db6-1018-4a10-86c8-714429a1db12 tempest-VolumesSnapshotListTestJSON-1817796478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e9a75db6-1018-4a10-86c8-714429a1db12 tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-e9a75db6-1018-4a10-86c8-714429a1db12 tempest-VolumesSnapshotListTestJSON-1817796478 None] Creating offline snapshot 526c9d2a-2b10-4df5-b191-f9e61134edce of volume 0d6c7333-b000-41b2-816c-7211b59670a3 {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 13:17:01 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c1c720-93de-449d-9aee-389d1712b1d9]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:17:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e9a75db6-1018-4a10-86c8-714429a1db12 tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:01 devstack sudo[101506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9
Nov 19 13:17:01 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:01 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e9a75db6-1018-4a10-86c8-714429a1db12 tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9" returned: 0 in 0.512s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-e9a75db6-1018-4a10-86c8-714429a1db12 tempest-VolumesSnapshotListTestJSON-1817796478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d6c7333-b000-41b2-816c-7211b59670a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:17:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e9a75db6-1018-4a10-86c8-714429a1db12 tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:01 devstack sudo[101511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce 1G
Nov 19 13:17:01 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:02 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e9a75db6-1018-4a10-86c8-714429a1db12 tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce 1G" returned: 0 in 0.506s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e9a75db6-1018-4a10-86c8-714429a1db12 tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:02 devstack sudo[101516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce
Nov 19 13:17:02 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:02 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e9a75db6-1018-4a10-86c8-714429a1db12 tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce" returned: 0 in 0.432s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:02 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-e9a75db6-1018-4a10-86c8-714429a1db12 tempest-VolumesSnapshotListTestJSON-1817796478 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce is being set with open permissions: ugo+rw
Nov 19 13:17:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e9a75db6-1018-4a10-86c8-714429a1db12 tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:02 devstack sudo[101522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce
Nov 19 13:17:02 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:03 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e9a75db6-1018-4a10-86c8-714429a1db12 tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce" returned: 0 in 0.407s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e9a75db6-1018-4a10-86c8-714429a1db12 tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.914s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:03 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-e9a75db6-1018-4a10-86c8-714429a1db12 tempest-VolumesSnapshotListTestJSON-1817796478 None] Create snapshot completed successfully
Nov 19 13:17:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b1ff2f83-83b9-4436-ae73-2d023e2add5e tempest-VolumesSnapshotListTestJSON-1817796478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b1ff2f83-83b9-4436-ae73-2d023e2add5e tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:03 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-b1ff2f83-83b9-4436-ae73-2d023e2add5e tempest-VolumesSnapshotListTestJSON-1817796478 None] Creating offline snapshot 5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84 of volume 0d6c7333-b000-41b2-816c-7211b59670a3 {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 13:17:03 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d81ea0-418b-4e8c-af20-10c19dd15435]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:17:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b1ff2f83-83b9-4436-ae73-2d023e2add5e tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:03 devstack sudo[101525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce
Nov 19 13:17:03 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:04 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b1ff2f83-83b9-4436-ae73-2d023e2add5e tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce" returned: 0 in 0.518s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-b1ff2f83-83b9-4436-ae73-2d023e2add5e tempest-VolumesSnapshotListTestJSON-1817796478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d6c7333-b000-41b2-816c-7211b59670a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:17:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b1ff2f83-83b9-4436-ae73-2d023e2add5e tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:04 devstack sudo[101530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84 1G
Nov 19 13:17:04 devstack sudo[101530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 13:17:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:17:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:17:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:04 devstack sudo[101535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:17:04 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:04 devstack sudo[101530]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b1ff2f83-83b9-4436-ae73-2d023e2add5e tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84 1G" returned: 0 in 0.527s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b1ff2f83-83b9-4436-ae73-2d023e2add5e tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:04 devstack sudo[101537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84
Nov 19 13:17:04 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:04 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.443s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:04 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:17:05 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b1ff2f83-83b9-4436-ae73-2d023e2add5e tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84" returned: 0 in 0.455s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:05 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-b1ff2f83-83b9-4436-ae73-2d023e2add5e tempest-VolumesSnapshotListTestJSON-1817796478 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84 is being set with open permissions: ugo+rw
Nov 19 13:17:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b1ff2f83-83b9-4436-ae73-2d023e2add5e tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:05 devstack sudo[101543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84
Nov 19 13:17:05 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:05 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b1ff2f83-83b9-4436-ae73-2d023e2add5e tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84" returned: 0 in 0.413s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b1ff2f83-83b9-4436-ae73-2d023e2add5e tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.962s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:05 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-b1ff2f83-83b9-4436-ae73-2d023e2add5e tempest-VolumesSnapshotListTestJSON-1817796478 None] Create snapshot completed successfully
Nov 19 13:17:06 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-537a0732-f5fd-4919-a6f2-4507cec2ad1c tempest-VolumesSnapshotListTestJSON-1817796478 None] Acquiring lock "cinder-5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:06 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-537a0732-f5fd-4919-a6f2-4507cec2ad1c tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "cinder-5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:06 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-537a0732-f5fd-4919-a6f2-4507cec2ad1c tempest-VolumesSnapshotListTestJSON-1817796478 None] Acquiring lock "cinder-quobyte-0d6c7333-b000-41b2-816c-7211b59670a3" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:06 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-537a0732-f5fd-4919-a6f2-4507cec2ad1c tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "cinder-quobyte-0d6c7333-b000-41b2-816c-7211b59670a3" acquired by "delete_snapshot" :: waited 0.006s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:06 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-537a0732-f5fd-4919-a6f2-4507cec2ad1c tempest-VolumesSnapshotListTestJSON-1817796478 None] Acquiring lock "cinder-quobyte-5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:06 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-537a0732-f5fd-4919-a6f2-4507cec2ad1c tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "cinder-quobyte-5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-537a0732-f5fd-4919-a6f2-4507cec2ad1c tempest-VolumesSnapshotListTestJSON-1817796478 None] Deleting offline snapshot 5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84 of volume 0d6c7333-b000-41b2-816c-7211b59670a3 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 13:17:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-537a0732-f5fd-4919-a6f2-4507cec2ad1c tempest-VolumesSnapshotListTestJSON-1817796478 None] snapshot_file for this snap is: volume-0d6c7333-b000-41b2-816c-7211b59670a3.5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 13:17:06 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d569d4-ed40-40a6-85d0-52e732b145af]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:17:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-537a0732-f5fd-4919-a6f2-4507cec2ad1c tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:06 devstack sudo[101546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84
Nov 19 13:17:06 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:06 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-537a0732-f5fd-4919-a6f2-4507cec2ad1c tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84" returned: 0 in 0.514s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-537a0732-f5fd-4919-a6f2-4507cec2ad1c tempest-VolumesSnapshotListTestJSON-1817796478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d6c7333-b000-41b2-816c-7211b59670a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:17:06 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d24d50-c326-48a2-b329-4004bd5e9cf1]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:17:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-537a0732-f5fd-4919-a6f2-4507cec2ad1c tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:06 devstack sudo[101551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce
Nov 19 13:17:06 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:07 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-537a0732-f5fd-4919-a6f2-4507cec2ad1c tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce" returned: 0 in 0.503s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-537a0732-f5fd-4919-a6f2-4507cec2ad1c tempest-VolumesSnapshotListTestJSON-1817796478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d6c7333-b000-41b2-816c-7211b59670a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:17:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-537a0732-f5fd-4919-a6f2-4507cec2ad1c tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:07 devstack sudo[101556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84
Nov 19 13:17:07 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:07 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-537a0732-f5fd-4919-a6f2-4507cec2ad1c tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84" returned: 0 in 0.470s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-537a0732-f5fd-4919-a6f2-4507cec2ad1c tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:07 devstack sudo[101561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84
Nov 19 13:17:07 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:08 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-537a0732-f5fd-4919-a6f2-4507cec2ad1c tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84" returned: 0 in 0.408s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:08 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-537a0732-f5fd-4919-a6f2-4507cec2ad1c tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "cinder-quobyte-5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84" released by "_delete_snapshot" :: held 1.959s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:08 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-537a0732-f5fd-4919-a6f2-4507cec2ad1c tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "cinder-quobyte-0d6c7333-b000-41b2-816c-7211b59670a3" released by "delete_snapshot" :: held 1.970s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:08 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-537a0732-f5fd-4919-a6f2-4507cec2ad1c tempest-VolumesSnapshotListTestJSON-1817796478 None] Created reservations ['ddb1da4e-31ff-4f3c-b404-d1fceac51286', 'b999c834-669d-4d2e-a11d-66ae821cfdce', '6709c651-6cfb-40f4-a12d-11ac5e378585', '306a284b-85d0-4d78-bfd9-5bc4a73c027d'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:17:08 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-537a0732-f5fd-4919-a6f2-4507cec2ad1c tempest-VolumesSnapshotListTestJSON-1817796478 None] Delete snapshot completed successfully.
Nov 19 13:17:08 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-537a0732-f5fd-4919-a6f2-4507cec2ad1c tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "cinder-5f32e83f-1ec7-47fc-be8e-6c7c57f4ba84-delete_snapshot" released by "delete_snapshot" :: held 2.043s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:08 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-51d58724-eb9d-4d67-b456-50e530f13934 tempest-VolumesSnapshotListTestJSON-1817796478 None] Acquiring lock "cinder-526c9d2a-2b10-4df5-b191-f9e61134edce-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:08 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-51d58724-eb9d-4d67-b456-50e530f13934 tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "cinder-526c9d2a-2b10-4df5-b191-f9e61134edce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:08 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-51d58724-eb9d-4d67-b456-50e530f13934 tempest-VolumesSnapshotListTestJSON-1817796478 None] Acquiring lock "cinder-quobyte-0d6c7333-b000-41b2-816c-7211b59670a3" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:08 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-51d58724-eb9d-4d67-b456-50e530f13934 tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "cinder-quobyte-0d6c7333-b000-41b2-816c-7211b59670a3" acquired by "delete_snapshot" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:08 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-51d58724-eb9d-4d67-b456-50e530f13934 tempest-VolumesSnapshotListTestJSON-1817796478 None] Acquiring lock "cinder-quobyte-526c9d2a-2b10-4df5-b191-f9e61134edce" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:08 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-51d58724-eb9d-4d67-b456-50e530f13934 tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "cinder-quobyte-526c9d2a-2b10-4df5-b191-f9e61134edce" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:08 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-51d58724-eb9d-4d67-b456-50e530f13934 tempest-VolumesSnapshotListTestJSON-1817796478 None] Deleting offline snapshot 526c9d2a-2b10-4df5-b191-f9e61134edce of volume 0d6c7333-b000-41b2-816c-7211b59670a3 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 13:17:08 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-51d58724-eb9d-4d67-b456-50e530f13934 tempest-VolumesSnapshotListTestJSON-1817796478 None] snapshot_file for this snap is: volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 13:17:08 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fdc647-5d70-40e7-861d-cc751713f8c7]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:17:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-51d58724-eb9d-4d67-b456-50e530f13934 tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:08 devstack sudo[101564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce
Nov 19 13:17:08 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:08 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-51d58724-eb9d-4d67-b456-50e530f13934 tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce" returned: 0 in 0.510s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:08 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-51d58724-eb9d-4d67-b456-50e530f13934 tempest-VolumesSnapshotListTestJSON-1817796478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d6c7333-b000-41b2-816c-7211b59670a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:17:08 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[889922a2-4d06-404e-9460-a6229c5d6952]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:17:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-51d58724-eb9d-4d67-b456-50e530f13934 tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:08 devstack sudo[101569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9
Nov 19 13:17:08 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:09 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-51d58724-eb9d-4d67-b456-50e530f13934 tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9" returned: 0 in 0.504s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:09 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-51d58724-eb9d-4d67-b456-50e530f13934 tempest-VolumesSnapshotListTestJSON-1817796478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d6c7333-b000-41b2-816c-7211b59670a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:17:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-51d58724-eb9d-4d67-b456-50e530f13934 tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:09 devstack sudo[101574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce
Nov 19 13:17:09 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:09 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-51d58724-eb9d-4d67-b456-50e530f13934 tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce" returned: 0 in 0.457s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-51d58724-eb9d-4d67-b456-50e530f13934 tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:09 devstack sudo[101579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce
Nov 19 13:17:09 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:10 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-51d58724-eb9d-4d67-b456-50e530f13934 tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.526c9d2a-2b10-4df5-b191-f9e61134edce" returned: 0 in 0.413s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-51d58724-eb9d-4d67-b456-50e530f13934 tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "cinder-quobyte-526c9d2a-2b10-4df5-b191-f9e61134edce" released by "_delete_snapshot" :: held 1.933s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-51d58724-eb9d-4d67-b456-50e530f13934 tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "cinder-quobyte-0d6c7333-b000-41b2-816c-7211b59670a3" released by "delete_snapshot" :: held 1.944s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:10 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-51d58724-eb9d-4d67-b456-50e530f13934 tempest-VolumesSnapshotListTestJSON-1817796478 None] Created reservations ['7a1ea844-317c-4cf2-8e7e-79e4dcc24f2a', '19ef47d9-7c36-46a5-a308-10064c1f2925', 'c885c981-e8c3-4449-bbb0-8de3731215a5', '17890118-ff93-4629-86c6-f386098405c4'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:17:10 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-51d58724-eb9d-4d67-b456-50e530f13934 tempest-VolumesSnapshotListTestJSON-1817796478 None] Delete snapshot completed successfully.
Nov 19 13:17:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-51d58724-eb9d-4d67-b456-50e530f13934 tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "cinder-526c9d2a-2b10-4df5-b191-f9e61134edce-delete_snapshot" released by "delete_snapshot" :: held 2.021s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c90caf2c-fbd1-499f-9f93-99748f258ca4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Acquiring lock "cinder-6d2e8273-9454-4895-8858-1e0eaa951df9-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c90caf2c-fbd1-499f-9f93-99748f258ca4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "cinder-6d2e8273-9454-4895-8858-1e0eaa951df9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c90caf2c-fbd1-499f-9f93-99748f258ca4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Acquiring lock "cinder-quobyte-0d6c7333-b000-41b2-816c-7211b59670a3" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c90caf2c-fbd1-499f-9f93-99748f258ca4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "cinder-quobyte-0d6c7333-b000-41b2-816c-7211b59670a3" acquired by "delete_snapshot" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c90caf2c-fbd1-499f-9f93-99748f258ca4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Acquiring lock "cinder-quobyte-6d2e8273-9454-4895-8858-1e0eaa951df9" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c90caf2c-fbd1-499f-9f93-99748f258ca4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "cinder-quobyte-6d2e8273-9454-4895-8858-1e0eaa951df9" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:10 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-c90caf2c-fbd1-499f-9f93-99748f258ca4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Deleting offline snapshot 6d2e8273-9454-4895-8858-1e0eaa951df9 of volume 0d6c7333-b000-41b2-816c-7211b59670a3 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 13:17:10 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-c90caf2c-fbd1-499f-9f93-99748f258ca4 tempest-VolumesSnapshotListTestJSON-1817796478 None] snapshot_file for this snap is: volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 13:17:10 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafbf461-2937-4ae6-8a1d-b5ee79c48d9b]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:17:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c90caf2c-fbd1-499f-9f93-99748f258ca4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:10 devstack sudo[101582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9
Nov 19 13:17:10 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:10 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c90caf2c-fbd1-499f-9f93-99748f258ca4 tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9" returned: 0 in 0.511s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:10 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-c90caf2c-fbd1-499f-9f93-99748f258ca4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d6c7333-b000-41b2-816c-7211b59670a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:17:10 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[287e4a41-b6b2-49a8-a948-b196e427ad6e]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:17:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c90caf2c-fbd1-499f-9f93-99748f258ca4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:11 devstack sudo[101587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3
Nov 19 13:17:11 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:11 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c90caf2c-fbd1-499f-9f93-99748f258ca4 tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3" returned: 0 in 0.514s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c90caf2c-fbd1-499f-9f93-99748f258ca4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:11 devstack sudo[101592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9
Nov 19 13:17:11 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:11 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c90caf2c-fbd1-499f-9f93-99748f258ca4 tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9" returned: 0 in 0.449s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c90caf2c-fbd1-499f-9f93-99748f258ca4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:11 devstack sudo[101597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9
Nov 19 13:17:11 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:12 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c90caf2c-fbd1-499f-9f93-99748f258ca4 tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3.6d2e8273-9454-4895-8858-1e0eaa951df9" returned: 0 in 0.409s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c90caf2c-fbd1-499f-9f93-99748f258ca4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "cinder-quobyte-6d2e8273-9454-4895-8858-1e0eaa951df9" released by "_delete_snapshot" :: held 1.938s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c90caf2c-fbd1-499f-9f93-99748f258ca4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "cinder-quobyte-0d6c7333-b000-41b2-816c-7211b59670a3" released by "delete_snapshot" :: held 1.951s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:12 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=71,cinder:UPDATE=93,cinder:DELETE=7,cinder:INSERT=23 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:17:12 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:UPDATE=78,cinder:SELECT=73,cinder:DELETE=10,cinder:INSERT=17 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:17:12 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-c90caf2c-fbd1-499f-9f93-99748f258ca4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Created reservations ['2312d734-2ec3-4784-bd3f-fa8b6fa8ca7b', '6c16e4fc-a97e-4844-81dd-59b8f2fac28e', '91600578-9199-4ebc-84c8-9bb84578a5b4', 'e73bc625-0917-4e02-bdd4-a62f6a2ee22c'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:17:12 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-c90caf2c-fbd1-499f-9f93-99748f258ca4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Delete snapshot completed successfully.
Nov 19 13:17:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c90caf2c-fbd1-499f-9f93-99748f258ca4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "cinder-6d2e8273-9454-4895-8858-1e0eaa951df9-delete_snapshot" released by "delete_snapshot" :: held 2.033s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-7d1463a8-4468-4ad7-b52c-bb0264de22f4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Acquiring lock "cinder-0d6c7333-b000-41b2-816c-7211b59670a3-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-7d1463a8-4468-4ad7-b52c-bb0264de22f4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "cinder-0d6c7333-b000-41b2-816c-7211b59670a3-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-7d1463a8-4468-4ad7-b52c-bb0264de22f4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Acquiring lock "cinder-quobyte-0d6c7333-b000-41b2-816c-7211b59670a3" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-7d1463a8-4468-4ad7-b52c-bb0264de22f4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "cinder-quobyte-0d6c7333-b000-41b2-816c-7211b59670a3" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:12 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91ffd6a-82ee-4fde-9db3-8cef2055a3c9]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:17:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7d1463a8-4468-4ad7-b52c-bb0264de22f4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:12 devstack sudo[101600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3
Nov 19 13:17:12 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:13 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7d1463a8-4468-4ad7-b52c-bb0264de22f4 tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3" returned: 0 in 0.503s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7d1463a8-4468-4ad7-b52c-bb0264de22f4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:13 devstack sudo[101606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3
Nov 19 13:17:13 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:13 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7d1463a8-4468-4ad7-b52c-bb0264de22f4 tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0d6c7333-b000-41b2-816c-7211b59670a3" returned: 0 in 0.416s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:13 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-7d1463a8-4468-4ad7-b52c-bb0264de22f4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "cinder-quobyte-0d6c7333-b000-41b2-816c-7211b59670a3" released by "delete_volume" :: held 0.951s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:13 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-7d1463a8-4468-4ad7-b52c-bb0264de22f4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Created reservations ['794781de-e603-4c92-8cff-84f8682c50e5', '3f2fcdd6-2412-4292-b41e-b83510be7f8b', 'f5937941-f650-468e-9ff1-7adb4f8fc542', 'b713e0cf-9082-4d6c-8d48-5249d1f6fd72'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:17:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7d1463a8-4468-4ad7-b52c-bb0264de22f4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7d1463a8-4468-4ad7-b52c-bb0264de22f4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:13 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7d1463a8-4468-4ad7-b52c-bb0264de22f4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:17:13 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7d1463a8-4468-4ad7-b52c-bb0264de22f4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:17:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7d1463a8-4468-4ad7-b52c-bb0264de22f4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7d1463a8-4468-4ad7-b52c-bb0264de22f4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:13 devstack sudo[101609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:17:13 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:14 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7d1463a8-4468-4ad7-b52c-bb0264de22f4 tempest-VolumesSnapshotListTestJSON-1817796478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.468s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:14 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-7d1463a8-4468-4ad7-b52c-bb0264de22f4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:17:14 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-7d1463a8-4468-4ad7-b52c-bb0264de22f4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Deleted volume successfully.
Nov 19 13:17:14 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-7d1463a8-4468-4ad7-b52c-bb0264de22f4 tempest-VolumesSnapshotListTestJSON-1817796478 None] Lock "cinder-0d6c7333-b000-41b2-816c-7211b59670a3-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:15 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:17:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Flow 'volume_create_manager' (92205e72-a41f-49f6-b674-baf1469da6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c3aab4d-f2fd-45cb-a97e-d9bdd5162b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c3aab4d-f2fd-45cb-a97e-d9bdd5162b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1250088280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d244c9-04c2-46cb-8923-e68968d246a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a901f0b62c1d48f9935342f304345354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:15Z,use_quota=True,user_id='63d56ac29aa64996a1f88a660cae84b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a918be-d3c2-45e7-834e-c79f2b86bbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a918be-d3c2-45e7-834e-c79f2b86bbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e041bbc-51d2-4df1-a474-45613a1b6bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e041bbc-51d2-4df1-a474-45613a1b6bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4d244c9-04c2-46cb-8923-e68968d246a7', 'volume_name': 'volume-c4d244c9-04c2-46cb-8923-e68968d246a7', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f447c454-c900-463b-bdc0-41014d65b14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f447c454-c900-463b-bdc0-41014d65b14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d4842a-345f-41e3-a9bb-431c6f746d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:15 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Volume c4d244c9-04c2-46cb-8923-e68968d246a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4d244c9-04c2-46cb-8923-e68968d246a7', 'volume_size': 1}
Nov 19 13:17:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:15 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1250088280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d244c9-04c2-46cb-8923-e68968d246a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a901f0b62c1d48f9935342f304345354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:15Z,use_quota=True,user_id='63d56ac29aa64996a1f88a660cae84b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:17:15 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Creating volume c4d244c9-04c2-46cb-8923-e68968d246a7 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:17:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:15 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:17:15 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:17:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:15 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:17:15 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:17:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:15 devstack sudo[101612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7 1073741824
Nov 19 13:17:15 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:15 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7 1073741824" returned: 0 in 0.519s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:15 devstack sudo[101617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7
Nov 19 13:17:15 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:16 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7" returned: 0 in 0.402s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:16 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:17:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d4842a-345f-41e3-a9bb-431c6f746d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4d244c9-04c2-46cb-8923-e68968d246a7', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87364149-6be3-473d-a717-a4bfc51673eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:16 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Volume volume-c4d244c9-04c2-46cb-8923-e68968d246a7 (c4d244c9-04c2-46cb-8923-e68968d246a7): created successfully
Nov 19 13:17:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87364149-6be3-473d-a717-a4bfc51673eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Flow 'volume_create_manager' (92205e72-a41f-49f6-b674-baf1469da6ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:16 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-18fa79d6-6c9f-4482-947b-badd4e8e5267 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Created volume successfully.
Nov 19 13:17:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a253c157-225b-48a6-83d0-00265600ffbb tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a253c157-225b-48a6-83d0-00265600ffbb tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-a253c157-225b-48a6-83d0-00265600ffbb tempest-CreateVolumesFromSnapshotTest-2084197952 None] Creating offline snapshot 8577b1aa-d9cb-406a-9ed0-918a9bf0cc44 of volume c4d244c9-04c2-46cb-8923-e68968d246a7 {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 13:17:17 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[571f423b-768a-49b4-a252-41e40b1f71c8]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:17:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a253c157-225b-48a6-83d0-00265600ffbb tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:17 devstack sudo[101620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7
Nov 19 13:17:17 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:17 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a253c157-225b-48a6-83d0-00265600ffbb tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7" returned: 0 in 0.508s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a253c157-225b-48a6-83d0-00265600ffbb tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7.8577b1aa-d9cb-406a-9ed0-918a9bf0cc44 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:17 devstack sudo[101626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7.8577b1aa-d9cb-406a-9ed0-918a9bf0cc44 1G
Nov 19 13:17:17 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:18 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a253c157-225b-48a6-83d0-00265600ffbb tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7.8577b1aa-d9cb-406a-9ed0-918a9bf0cc44 1G" returned: 0 in 0.474s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a253c157-225b-48a6-83d0-00265600ffbb tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d244c9-04c2-46cb-8923-e68968d246a7 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7.8577b1aa-d9cb-406a-9ed0-918a9bf0cc44 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:18 devstack sudo[101631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d244c9-04c2-46cb-8923-e68968d246a7 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7.8577b1aa-d9cb-406a-9ed0-918a9bf0cc44
Nov 19 13:17:18 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:18 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a253c157-225b-48a6-83d0-00265600ffbb tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d244c9-04c2-46cb-8923-e68968d246a7 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7.8577b1aa-d9cb-406a-9ed0-918a9bf0cc44" returned: 0 in 0.432s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:18 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-a253c157-225b-48a6-83d0-00265600ffbb tempest-CreateVolumesFromSnapshotTest-2084197952 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7.8577b1aa-d9cb-406a-9ed0-918a9bf0cc44 is being set with open permissions: ugo+rw
Nov 19 13:17:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a253c157-225b-48a6-83d0-00265600ffbb tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7.8577b1aa-d9cb-406a-9ed0-918a9bf0cc44 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:18 devstack sudo[101636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7.8577b1aa-d9cb-406a-9ed0-918a9bf0cc44
Nov 19 13:17:18 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:19 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a253c157-225b-48a6-83d0-00265600ffbb tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7.8577b1aa-d9cb-406a-9ed0-918a9bf0cc44" returned: 0 in 0.414s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a253c157-225b-48a6-83d0-00265600ffbb tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:19 devstack sudo[101639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7.info
Nov 19 13:17:19 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:19 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a253c157-225b-48a6-83d0-00265600ffbb tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7.info" returned: 0 in 0.429s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:19 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-a253c157-225b-48a6-83d0-00265600ffbb tempest-CreateVolumesFromSnapshotTest-2084197952 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7.info is being set with open permissions: ugo+rw
Nov 19 13:17:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a253c157-225b-48a6-83d0-00265600ffbb tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:19 devstack sudo[101642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7.info
Nov 19 13:17:19 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:20 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a253c157-225b-48a6-83d0-00265600ffbb tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7.info" returned: 0 in 0.414s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a253c157-225b-48a6-83d0-00265600ffbb tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.707s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:20 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-a253c157-225b-48a6-83d0-00265600ffbb tempest-CreateVolumesFromSnapshotTest-2084197952 None] Create snapshot completed successfully
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Flow 'volume_create_manager' (145f1af2-df72-41ff-b701-35152266f07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da369b3-e2a2-46d4-9ed0-0ebda24cd7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da369b3-e2a2-46d4-9ed0-0ebda24cd7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-724487750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5ee141-1147-4475-8899-f41cb71b613d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a901f0b62c1d48f9935342f304345354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:21Z,use_quota=True,user_id='63d56ac29aa64996a1f88a660cae84b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692e9797-a25c-49d4-adcc-04973b7f0894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692e9797-a25c-49d4-adcc-04973b7f0894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5849442d-1ce6-4d32-9024-e95d82665cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5849442d-1ce6-4d32-9024-e95d82665cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a5ee141-1147-4475-8899-f41cb71b613d', 'volume_name': 'volume-0a5ee141-1147-4475-8899-f41cb71b613d', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adbc8ada-ecfd-4415-8cab-4f1f64faa373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adbc8ada-ecfd-4415-8cab-4f1f64faa373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49bc4ddd-9f7b-42ff-bc17-26f6ae73c2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:20 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Volume 0a5ee141-1147-4475-8899-f41cb71b613d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a5ee141-1147-4475-8899-f41cb71b613d', 'volume_size': 1}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-724487750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5ee141-1147-4475-8899-f41cb71b613d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a901f0b62c1d48f9935342f304345354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:21Z,use_quota=True,user_id='63d56ac29aa64996a1f88a660cae84b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Creating volume 0a5ee141-1147-4475-8899-f41cb71b613d {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:17:20 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0a5ee141-1147-4475-8899-f41cb71b613d 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:20 devstack sudo[101645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0a5ee141-1147-4475-8899-f41cb71b613d 1073741824
Nov 19 13:17:20 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Flow 'volume_create_manager' (7f73d62b-e7c1-4da2-bf18-c4a59c38fa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7987a5-fe61-47d1-854e-0f771490b107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7987a5-fe61-47d1-854e-0f771490b107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1428699407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1928915f-6939-44de-b617-7577882922c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a901f0b62c1d48f9935342f304345354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:21Z,use_quota=True,user_id='63d56ac29aa64996a1f88a660cae84b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2cd12c1-9501-4b86-82c7-ad4e63e5bae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2cd12c1-9501-4b86-82c7-ad4e63e5bae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (304c85ba-25b3-4881-8a12-d7fa888ce4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (304c85ba-25b3-4881-8a12-d7fa888ce4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1928915f-6939-44de-b617-7577882922c3', 'volume_name': 'volume-1928915f-6939-44de-b617-7577882922c3', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (462c3f4b-a0db-4c33-8449-32dbe7aa14e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (462c3f4b-a0db-4c33-8449-32dbe7aa14e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:20 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bafa71d-9ca0-4972-ae06-dacd3b980ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:20 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Volume 1928915f-6939-44de-b617-7577882922c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1928915f-6939-44de-b617-7577882922c3', 'volume_size': 1}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Flow 'volume_create_manager' (1ad967e3-0a16-4f22-a631-1a09ca5fa786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0fd5043-5202-4b6c-ab2c-83dfb01c9858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0fd5043-5202-4b6c-ab2c-83dfb01c9858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1111670875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d3de29-8eb2-43e4-aebd-b21f23e078db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a901f0b62c1d48f9935342f304345354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:21Z,use_quota=True,user_id='63d56ac29aa64996a1f88a660cae84b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb21fd7d-e36a-4c62-9cee-dcc5c0042283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb21fd7d-e36a-4c62-9cee-dcc5c0042283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a5c3e4e-6b03-4bef-9df8-eadc558f1383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a5c3e4e-6b03-4bef-9df8-eadc558f1383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d3de29-8eb2-43e4-aebd-b21f23e078db', 'volume_name': 'volume-05d3de29-8eb2-43e4-aebd-b21f23e078db', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (872d9ea0-8ddd-4e1b-8efd-a1f7b147616f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (872d9ea0-8ddd-4e1b-8efd-a1f7b147616f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522a106a-36c0-44c4-976f-a6e3f4c0b636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:21 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Volume 05d3de29-8eb2-43e4-aebd-b21f23e078db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d3de29-8eb2-43e4-aebd-b21f23e078db', 'volume_size': 1}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Flow 'volume_create_manager' (2ffc6eee-76c7-4521-8f59-3b328a42af54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cadff77-3d7b-4371-9f88-71106dc2aa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cadff77-3d7b-4371-9f88-71106dc2aa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1655100361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da719a3-c846-4632-9714-5992bfb078c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a901f0b62c1d48f9935342f304345354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:21Z,use_quota=True,user_id='63d56ac29aa64996a1f88a660cae84b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (684614f7-b162-4de4-9913-c239a352cf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (684614f7-b162-4de4-9913-c239a352cf03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e3cb45-6d74-440c-902d-3bbf41a9ccc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e3cb45-6d74-440c-902d-3bbf41a9ccc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7da719a3-c846-4632-9714-5992bfb078c1', 'volume_name': 'volume-7da719a3-c846-4632-9714-5992bfb078c1', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaf484c8-981c-4538-a7eb-a5dce2d225c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaf484c8-981c-4538-a7eb-a5dce2d225c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e38b9bb-9f89-4f77-b845-1cd0093b19b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:21 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Volume 7da719a3-c846-4632-9714-5992bfb078c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7da719a3-c846-4632-9714-5992bfb078c1', 'volume_size': 1}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:21 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0a5ee141-1147-4475-8899-f41cb71b613d 1073741824" returned: 0 in 0.596s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0a5ee141-1147-4475-8899-f41cb71b613d {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:21 devstack sudo[101650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0a5ee141-1147-4475-8899-f41cb71b613d
Nov 19 13:17:21 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Flow 'volume_create_manager' (eb68d7c0-40e7-4466-a10e-c0784e6c049b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08225649-17b0-40f7-b490-45af276b7b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08225649-17b0-40f7-b490-45af276b7b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1185707931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd8b028-cdde-4a9f-9f8d-73654b5459a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a901f0b62c1d48f9935342f304345354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:21Z,use_quota=True,user_id='63d56ac29aa64996a1f88a660cae84b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0acc7e7a-92ae-4101-b006-a281801101fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0acc7e7a-92ae-4101-b006-a281801101fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae3e90c-c96a-410f-b7f1-1740514d2fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae3e90c-c96a-410f-b7f1-1740514d2fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcd8b028-cdde-4a9f-9f8d-73654b5459a9', 'volume_name': 'volume-fcd8b028-cdde-4a9f-9f8d-73654b5459a9', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b102368c-8ecf-4df1-956a-15bc9d203e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b102368c-8ecf-4df1-956a-15bc9d203e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3e1c70-f9b5-4be6-8f7e-3f7fe1af0e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:21 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Volume fcd8b028-cdde-4a9f-9f8d-73654b5459a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcd8b028-cdde-4a9f-9f8d-73654b5459a9', 'volume_size': 1}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:21 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0a5ee141-1147-4475-8899-f41cb71b613d" returned: 0 in 0.415s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.814s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1428699407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1928915f-6939-44de-b617-7577882922c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a901f0b62c1d48f9935342f304345354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:21Z,use_quota=True,user_id='63d56ac29aa64996a1f88a660cae84b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Creating volume 1928915f-6939-44de-b617-7577882922c3 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:17:21 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1928915f-6939-44de-b617-7577882922c3 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49bc4ddd-9f7b-42ff-bc17-26f6ae73c2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a5ee141-1147-4475-8899-f41cb71b613d', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:21 devstack sudo[101653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1928915f-6939-44de-b617-7577882922c3 1073741824
Nov 19 13:17:21 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa03945-6bda-40d8-aac9-7d47061e50a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:21 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Volume volume-0a5ee141-1147-4475-8899-f41cb71b613d (0a5ee141-1147-4475-8899-f41cb71b613d): created successfully
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa03945-6bda-40d8-aac9-7d47061e50a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:21 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Flow 'volume_create_manager' (145f1af2-df72-41ff-b701-35152266f07a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:21 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-ee9671f9-a569-498b-a5ac-3f880b47ac48 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Created volume successfully.
Nov 19 13:17:22 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1928915f-6939-44de-b617-7577882922c3 1073741824" returned: 0 in 0.494s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1928915f-6939-44de-b617-7577882922c3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:22 devstack sudo[101658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1928915f-6939-44de-b617-7577882922c3
Nov 19 13:17:22 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:22 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1928915f-6939-44de-b617-7577882922c3" returned: 0 in 0.409s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:22 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:17:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.586s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:22 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1111670875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d3de29-8eb2-43e4-aebd-b21f23e078db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a901f0b62c1d48f9935342f304345354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:21Z,use_quota=True,user_id='63d56ac29aa64996a1f88a660cae84b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:17:22 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Creating volume 05d3de29-8eb2-43e4-aebd-b21f23e078db {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:17:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:22 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:17:22 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:17:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:22 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:17:22 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:17:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-05d3de29-8eb2-43e4-aebd-b21f23e078db 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:22 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bafa71d-9ca0-4972-ae06-dacd3b980ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1928915f-6939-44de-b617-7577882922c3', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:22 devstack sudo[101661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-05d3de29-8eb2-43e4-aebd-b21f23e078db 1073741824
Nov 19 13:17:22 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:22 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89310b85-06d1-403d-96e3-14ec0f2898b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:22 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Volume volume-1928915f-6939-44de-b617-7577882922c3 (1928915f-6939-44de-b617-7577882922c3): created successfully
Nov 19 13:17:22 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89310b85-06d1-403d-96e3-14ec0f2898b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:22 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Flow 'volume_create_manager' (7f73d62b-e7c1-4da2-bf18-c4a59c38fa01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:22 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-cd7b8dfc-ea1c-433f-b5f2-c8d0df1ff2d9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Created volume successfully.
Nov 19 13:17:23 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-05d3de29-8eb2-43e4-aebd-b21f23e078db 1073741824" returned: 0 in 0.496s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-05d3de29-8eb2-43e4-aebd-b21f23e078db {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:23 devstack sudo[101667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-05d3de29-8eb2-43e4-aebd-b21f23e078db
Nov 19 13:17:23 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:23 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-05d3de29-8eb2-43e4-aebd-b21f23e078db" returned: 0 in 0.416s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:17:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.312s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1655100361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da719a3-c846-4632-9714-5992bfb078c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a901f0b62c1d48f9935342f304345354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:21Z,use_quota=True,user_id='63d56ac29aa64996a1f88a660cae84b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:17:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Creating volume 7da719a3-c846-4632-9714-5992bfb078c1 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:17:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:17:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:17:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:17:23 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:17:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7da719a3-c846-4632-9714-5992bfb078c1 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:23 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522a106a-36c0-44c4-976f-a6e3f4c0b636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d3de29-8eb2-43e4-aebd-b21f23e078db', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:23 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b523f32-cc3b-4cf7-a19a-437747385da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:23 devstack sudo[101670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7da719a3-c846-4632-9714-5992bfb078c1 1073741824
Nov 19 13:17:23 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:23 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Volume volume-05d3de29-8eb2-43e4-aebd-b21f23e078db (05d3de29-8eb2-43e4-aebd-b21f23e078db): created successfully
Nov 19 13:17:23 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b523f32-cc3b-4cf7-a19a-437747385da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:23 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Flow 'volume_create_manager' (1ad967e3-0a16-4f22-a631-1a09ca5fa786) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:23 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-ae2b271d-ab02-4bd5-99ac-c2448ef2094b tempest-CreateVolumesFromSnapshotTest-2084197952 None] Created volume successfully.
Nov 19 13:17:24 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7da719a3-c846-4632-9714-5992bfb078c1 1073741824" returned: 0 in 0.491s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7da719a3-c846-4632-9714-5992bfb078c1 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:24 devstack sudo[101675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7da719a3-c846-4632-9714-5992bfb078c1
Nov 19 13:17:24 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:24 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7da719a3-c846-4632-9714-5992bfb078c1" returned: 0 in 0.404s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:24 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:17:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.037s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:24 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1185707931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd8b028-cdde-4a9f-9f8d-73654b5459a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a901f0b62c1d48f9935342f304345354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:21Z,use_quota=True,user_id='63d56ac29aa64996a1f88a660cae84b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:17:24 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Creating volume fcd8b028-cdde-4a9f-9f8d-73654b5459a9 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:17:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:24 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:17:24 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:17:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:24 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:17:24 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:17:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fcd8b028-cdde-4a9f-9f8d-73654b5459a9 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:24 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e38b9bb-9f89-4f77-b845-1cd0093b19b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7da719a3-c846-4632-9714-5992bfb078c1', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:24 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a451f07-75fa-40bf-bfa1-d95e255b658f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:24 devstack sudo[101678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fcd8b028-cdde-4a9f-9f8d-73654b5459a9 1073741824
Nov 19 13:17:24 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:24 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Volume volume-7da719a3-c846-4632-9714-5992bfb078c1 (7da719a3-c846-4632-9714-5992bfb078c1): created successfully
Nov 19 13:17:24 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a451f07-75fa-40bf-bfa1-d95e255b658f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:24 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Flow 'volume_create_manager' (2ffc6eee-76c7-4521-8f59-3b328a42af54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:24 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-abd07fbb-dfbe-494b-b3d6-4aaa40902c3a tempest-CreateVolumesFromSnapshotTest-2084197952 None] Created volume successfully.
Nov 19 13:17:25 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fcd8b028-cdde-4a9f-9f8d-73654b5459a9 1073741824" returned: 0 in 0.514s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fcd8b028-cdde-4a9f-9f8d-73654b5459a9 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:25 devstack sudo[101683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fcd8b028-cdde-4a9f-9f8d-73654b5459a9
Nov 19 13:17:25 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:25 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fcd8b028-cdde-4a9f-9f8d-73654b5459a9" returned: 0 in 0.412s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:25 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:17:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3e1c70-f9b5-4be6-8f7e-3f7fe1af0e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcd8b028-cdde-4a9f-9f8d-73654b5459a9', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8d156e-ac16-4b15-bbb9-35c6b1dcffb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:25 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Volume volume-fcd8b028-cdde-4a9f-9f8d-73654b5459a9 (fcd8b028-cdde-4a9f-9f8d-73654b5459a9): created successfully
Nov 19 13:17:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8d156e-ac16-4b15-bbb9-35c6b1dcffb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:25 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Flow 'volume_create_manager' (eb68d7c0-40e7-4466-a10e-c0784e6c049b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:25 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-d9b6aacf-7f03-467b-b462-092dd486a6a0 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Created volume successfully.
Nov 19 13:17:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9cf9510c-ed0b-4876-96ac-6443a90e7355 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "cinder-fcd8b028-cdde-4a9f-9f8d-73654b5459a9-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9cf9510c-ed0b-4876-96ac-6443a90e7355 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-fcd8b028-cdde-4a9f-9f8d-73654b5459a9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9cf9510c-ed0b-4876-96ac-6443a90e7355 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "cinder-quobyte-fcd8b028-cdde-4a9f-9f8d-73654b5459a9" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9cf9510c-ed0b-4876-96ac-6443a90e7355 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-quobyte-fcd8b028-cdde-4a9f-9f8d-73654b5459a9" acquired by "delete_volume" :: waited 0.012s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:25 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[992c95f3-4cfa-4995-be02-226e7404abfd]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:17:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9cf9510c-ed0b-4876-96ac-6443a90e7355 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fcd8b028-cdde-4a9f-9f8d-73654b5459a9 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:25 devstack sudo[101686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fcd8b028-cdde-4a9f-9f8d-73654b5459a9
Nov 19 13:17:25 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:26 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9cf9510c-ed0b-4876-96ac-6443a90e7355 tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fcd8b028-cdde-4a9f-9f8d-73654b5459a9" returned: 0 in 0.506s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9cf9510c-ed0b-4876-96ac-6443a90e7355 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fcd8b028-cdde-4a9f-9f8d-73654b5459a9 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:26 devstack sudo[101691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fcd8b028-cdde-4a9f-9f8d-73654b5459a9
Nov 19 13:17:26 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:26 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9cf9510c-ed0b-4876-96ac-6443a90e7355 tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fcd8b028-cdde-4a9f-9f8d-73654b5459a9" returned: 0 in 0.415s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9cf9510c-ed0b-4876-96ac-6443a90e7355 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-quobyte-fcd8b028-cdde-4a9f-9f8d-73654b5459a9" released by "delete_volume" :: held 0.941s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:26 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-9cf9510c-ed0b-4876-96ac-6443a90e7355 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Created reservations ['b5c53221-9e44-4abb-885c-89707726cbd4', 'b3a9fd46-a77a-4a53-8059-0c420bfd0a7e', 'e434c572-c8cd-4b5d-b0c7-bf5a6634dd38', 'cd1e9521-612a-4fd5-953d-8c16391be545'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:17:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9cf9510c-ed0b-4876-96ac-6443a90e7355 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9cf9510c-ed0b-4876-96ac-6443a90e7355 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-9cf9510c-ed0b-4876-96ac-6443a90e7355 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:17:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-9cf9510c-ed0b-4876-96ac-6443a90e7355 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:17:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9cf9510c-ed0b-4876-96ac-6443a90e7355 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9cf9510c-ed0b-4876-96ac-6443a90e7355 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:26 devstack sudo[101694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:17:26 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-922b58b9-5ec4-4c30-bc44-7f135410a7e8 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "cinder-7da719a3-c846-4632-9714-5992bfb078c1-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-922b58b9-5ec4-4c30-bc44-7f135410a7e8 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-7da719a3-c846-4632-9714-5992bfb078c1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-922b58b9-5ec4-4c30-bc44-7f135410a7e8 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "cinder-quobyte-7da719a3-c846-4632-9714-5992bfb078c1" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-922b58b9-5ec4-4c30-bc44-7f135410a7e8 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-quobyte-7da719a3-c846-4632-9714-5992bfb078c1" acquired by "delete_volume" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:26 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[841988d0-de00-41d6-b386-14063309af17]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:17:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-922b58b9-5ec4-4c30-bc44-7f135410a7e8 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7da719a3-c846-4632-9714-5992bfb078c1 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:27 devstack sudo[101696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7da719a3-c846-4632-9714-5992bfb078c1
Nov 19 13:17:27 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:27 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9cf9510c-ed0b-4876-96ac-6443a90e7355 tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.429s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:27 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-9cf9510c-ed0b-4876-96ac-6443a90e7355 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:17:27 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-9cf9510c-ed0b-4876-96ac-6443a90e7355 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Deleted volume successfully.
Nov 19 13:17:27 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-9cf9510c-ed0b-4876-96ac-6443a90e7355 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-fcd8b028-cdde-4a9f-9f8d-73654b5459a9-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:27 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-922b58b9-5ec4-4c30-bc44-7f135410a7e8 tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7da719a3-c846-4632-9714-5992bfb078c1" returned: 0 in 0.528s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-922b58b9-5ec4-4c30-bc44-7f135410a7e8 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7da719a3-c846-4632-9714-5992bfb078c1 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:27 devstack sudo[101702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7da719a3-c846-4632-9714-5992bfb078c1
Nov 19 13:17:27 devstack sudo[101702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:27 devstack sudo[101702]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-922b58b9-5ec4-4c30-bc44-7f135410a7e8 tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-7da719a3-c846-4632-9714-5992bfb078c1" returned: 0 in 0.418s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:27 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-922b58b9-5ec4-4c30-bc44-7f135410a7e8 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-quobyte-7da719a3-c846-4632-9714-5992bfb078c1" released by "delete_volume" :: held 0.967s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:27 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-922b58b9-5ec4-4c30-bc44-7f135410a7e8 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Created reservations ['3a942e5a-8398-4378-93f7-803449b2a9f0', '30c9f6c8-45bc-4441-b798-27318241ea8f', '155a7f4f-abeb-45b5-93a8-8731f37d10f9', '0376f85e-a94a-43bb-926b-030cd0940f88'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:17:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-922b58b9-5ec4-4c30-bc44-7f135410a7e8 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-922b58b9-5ec4-4c30-bc44-7f135410a7e8 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-922b58b9-5ec4-4c30-bc44-7f135410a7e8 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:17:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-922b58b9-5ec4-4c30-bc44-7f135410a7e8 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:17:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-922b58b9-5ec4-4c30-bc44-7f135410a7e8 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-922b58b9-5ec4-4c30-bc44-7f135410a7e8 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:28 devstack sudo[101705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:17:28 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:28 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-41d5ce76-df46-42af-adad-daf019214a11 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "cinder-05d3de29-8eb2-43e4-aebd-b21f23e078db-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:28 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-41d5ce76-df46-42af-adad-daf019214a11 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-05d3de29-8eb2-43e4-aebd-b21f23e078db-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:28 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-41d5ce76-df46-42af-adad-daf019214a11 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "cinder-quobyte-05d3de29-8eb2-43e4-aebd-b21f23e078db" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:28 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-41d5ce76-df46-42af-adad-daf019214a11 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-quobyte-05d3de29-8eb2-43e4-aebd-b21f23e078db" acquired by "delete_volume" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:28 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[951f9028-a494-4717-8511-5f292ab9c038]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:17:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-41d5ce76-df46-42af-adad-daf019214a11 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-05d3de29-8eb2-43e4-aebd-b21f23e078db {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:28 devstack sudo[101707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-05d3de29-8eb2-43e4-aebd-b21f23e078db
Nov 19 13:17:28 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:28 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-922b58b9-5ec4-4c30-bc44-7f135410a7e8 tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.465s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:28 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-922b58b9-5ec4-4c30-bc44-7f135410a7e8 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:17:28 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-922b58b9-5ec4-4c30-bc44-7f135410a7e8 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Deleted volume successfully.
Nov 19 13:17:28 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-922b58b9-5ec4-4c30-bc44-7f135410a7e8 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-7da719a3-c846-4632-9714-5992bfb078c1-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:28 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-41d5ce76-df46-42af-adad-daf019214a11 tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-05d3de29-8eb2-43e4-aebd-b21f23e078db" returned: 0 in 0.529s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-41d5ce76-df46-42af-adad-daf019214a11 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-05d3de29-8eb2-43e4-aebd-b21f23e078db {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:28 devstack sudo[101713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-05d3de29-8eb2-43e4-aebd-b21f23e078db
Nov 19 13:17:28 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:29 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-41d5ce76-df46-42af-adad-daf019214a11 tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-05d3de29-8eb2-43e4-aebd-b21f23e078db" returned: 0 in 0.418s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:29 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-41d5ce76-df46-42af-adad-daf019214a11 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-quobyte-05d3de29-8eb2-43e4-aebd-b21f23e078db" released by "delete_volume" :: held 0.968s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:29 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-41d5ce76-df46-42af-adad-daf019214a11 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Created reservations ['96811984-ce75-4cea-ad16-8c3c5a4daa05', 'a2e2c732-5739-4933-8c64-be4c98d57a53', '26d762e2-b81c-416e-9827-150bb7503c59', '529d6946-c520-4dbb-9b70-f8464719acab'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:17:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-41d5ce76-df46-42af-adad-daf019214a11 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-41d5ce76-df46-42af-adad-daf019214a11 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:29 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-41d5ce76-df46-42af-adad-daf019214a11 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:17:29 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-41d5ce76-df46-42af-adad-daf019214a11 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:17:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-41d5ce76-df46-42af-adad-daf019214a11 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-41d5ce76-df46-42af-adad-daf019214a11 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:29 devstack sudo[101716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:17:29 devstack sudo[101716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:29 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-274c9cc8-fd91-42b8-aef6-32d6e640e42c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "cinder-1928915f-6939-44de-b617-7577882922c3-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:29 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-274c9cc8-fd91-42b8-aef6-32d6e640e42c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-1928915f-6939-44de-b617-7577882922c3-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:29 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-274c9cc8-fd91-42b8-aef6-32d6e640e42c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "cinder-quobyte-1928915f-6939-44de-b617-7577882922c3" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:29 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-274c9cc8-fd91-42b8-aef6-32d6e640e42c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-quobyte-1928915f-6939-44de-b617-7577882922c3" acquired by "delete_volume" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:29 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[454d3d07-3ed1-426f-bc39-1cc845190f09]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:17:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-274c9cc8-fd91-42b8-aef6-32d6e640e42c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1928915f-6939-44de-b617-7577882922c3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:29 devstack sudo[101718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1928915f-6939-44de-b617-7577882922c3
Nov 19 13:17:29 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:29 devstack sudo[101716]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-41d5ce76-df46-42af-adad-daf019214a11 tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.450s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:29 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-41d5ce76-df46-42af-adad-daf019214a11 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:17:29 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-41d5ce76-df46-42af-adad-daf019214a11 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Deleted volume successfully.
Nov 19 13:17:29 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-41d5ce76-df46-42af-adad-daf019214a11 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-05d3de29-8eb2-43e4-aebd-b21f23e078db-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:29 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-274c9cc8-fd91-42b8-aef6-32d6e640e42c tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1928915f-6939-44de-b617-7577882922c3" returned: 0 in 0.525s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-274c9cc8-fd91-42b8-aef6-32d6e640e42c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1928915f-6939-44de-b617-7577882922c3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:29 devstack sudo[101724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1928915f-6939-44de-b617-7577882922c3
Nov 19 13:17:29 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:30 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-274c9cc8-fd91-42b8-aef6-32d6e640e42c tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1928915f-6939-44de-b617-7577882922c3" returned: 0 in 0.417s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-274c9cc8-fd91-42b8-aef6-32d6e640e42c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-quobyte-1928915f-6939-44de-b617-7577882922c3" released by "delete_volume" :: held 0.959s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:30 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-274c9cc8-fd91-42b8-aef6-32d6e640e42c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Created reservations ['3e6bd8be-2051-4da9-95d3-cbb2cc2705db', '14a30bbd-7c1c-491b-9c00-099b9f06dd54', '9500e50e-5547-4243-86a8-31c546511001', 'c3aff7aa-a776-4c5a-9cfc-719f68b2e2c8'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:17:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-274c9cc8-fd91-42b8-aef6-32d6e640e42c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-274c9cc8-fd91-42b8-aef6-32d6e640e42c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-274c9cc8-fd91-42b8-aef6-32d6e640e42c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:17:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-274c9cc8-fd91-42b8-aef6-32d6e640e42c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:17:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-274c9cc8-fd91-42b8-aef6-32d6e640e42c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-274c9cc8-fd91-42b8-aef6-32d6e640e42c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:30 devstack sudo[101727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:17:30 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b4ea3dc5-99e7-490f-b963-f4976a6fd3c9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "cinder-0a5ee141-1147-4475-8899-f41cb71b613d-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b4ea3dc5-99e7-490f-b963-f4976a6fd3c9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-0a5ee141-1147-4475-8899-f41cb71b613d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b4ea3dc5-99e7-490f-b963-f4976a6fd3c9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "cinder-quobyte-0a5ee141-1147-4475-8899-f41cb71b613d" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b4ea3dc5-99e7-490f-b963-f4976a6fd3c9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-quobyte-0a5ee141-1147-4475-8899-f41cb71b613d" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:30 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd1fdc4-886d-408f-88f8-73edd87842f3]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:17:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b4ea3dc5-99e7-490f-b963-f4976a6fd3c9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0a5ee141-1147-4475-8899-f41cb71b613d {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:30 devstack sudo[101729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0a5ee141-1147-4475-8899-f41cb71b613d
Nov 19 13:17:30 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:30 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-274c9cc8-fd91-42b8-aef6-32d6e640e42c tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.432s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:30 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-274c9cc8-fd91-42b8-aef6-32d6e640e42c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:17:30 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-274c9cc8-fd91-42b8-aef6-32d6e640e42c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Deleted volume successfully.
Nov 19 13:17:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-274c9cc8-fd91-42b8-aef6-32d6e640e42c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-1928915f-6939-44de-b617-7577882922c3-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:30 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b4ea3dc5-99e7-490f-b963-f4976a6fd3c9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0a5ee141-1147-4475-8899-f41cb71b613d" returned: 0 in 0.519s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b4ea3dc5-99e7-490f-b963-f4976a6fd3c9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0a5ee141-1147-4475-8899-f41cb71b613d {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:30 devstack sudo[101735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0a5ee141-1147-4475-8899-f41cb71b613d
Nov 19 13:17:30 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:31 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b4ea3dc5-99e7-490f-b963-f4976a6fd3c9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0a5ee141-1147-4475-8899-f41cb71b613d" returned: 0 in 0.414s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:31 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b4ea3dc5-99e7-490f-b963-f4976a6fd3c9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-quobyte-0a5ee141-1147-4475-8899-f41cb71b613d" released by "delete_volume" :: held 0.952s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:31 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-b4ea3dc5-99e7-490f-b963-f4976a6fd3c9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Created reservations ['b10bf831-b3b0-4883-a544-55c8b3fd7ca2', 'ea64428f-3ea8-4d82-9150-ac250547cb9a', 'fa7528e3-6fca-4b62-9908-8a623d7cafab', 'b11f6c17-1478-444f-95b5-82d00d8d65e9'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:17:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b4ea3dc5-99e7-490f-b963-f4976a6fd3c9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b4ea3dc5-99e7-490f-b963-f4976a6fd3c9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b4ea3dc5-99e7-490f-b963-f4976a6fd3c9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:17:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b4ea3dc5-99e7-490f-b963-f4976a6fd3c9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:17:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b4ea3dc5-99e7-490f-b963-f4976a6fd3c9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b4ea3dc5-99e7-490f-b963-f4976a6fd3c9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:31 devstack sudo[101738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:17:31 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:31 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-ca0f0be7-39a8-45f8-afe8-51d5a2cb703c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "cinder-8577b1aa-d9cb-406a-9ed0-918a9bf0cc44-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:31 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-ca0f0be7-39a8-45f8-afe8-51d5a2cb703c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-8577b1aa-d9cb-406a-9ed0-918a9bf0cc44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:31 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-ca0f0be7-39a8-45f8-afe8-51d5a2cb703c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "cinder-quobyte-c4d244c9-04c2-46cb-8923-e68968d246a7" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:31 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-ca0f0be7-39a8-45f8-afe8-51d5a2cb703c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-quobyte-c4d244c9-04c2-46cb-8923-e68968d246a7" acquired by "delete_snapshot" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:31 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-ca0f0be7-39a8-45f8-afe8-51d5a2cb703c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "cinder-quobyte-8577b1aa-d9cb-406a-9ed0-918a9bf0cc44" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:31 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-ca0f0be7-39a8-45f8-afe8-51d5a2cb703c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-quobyte-8577b1aa-d9cb-406a-9ed0-918a9bf0cc44" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-ca0f0be7-39a8-45f8-afe8-51d5a2cb703c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Deleting offline snapshot 8577b1aa-d9cb-406a-9ed0-918a9bf0cc44 of volume c4d244c9-04c2-46cb-8923-e68968d246a7 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 13:17:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-ca0f0be7-39a8-45f8-afe8-51d5a2cb703c tempest-CreateVolumesFromSnapshotTest-2084197952 None] snapshot_file for this snap is: volume-c4d244c9-04c2-46cb-8923-e68968d246a7.8577b1aa-d9cb-406a-9ed0-918a9bf0cc44 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 13:17:31 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a4f469-8c2d-473d-91ff-9a31d7e1fac4]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:17:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ca0f0be7-39a8-45f8-afe8-51d5a2cb703c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7.8577b1aa-d9cb-406a-9ed0-918a9bf0cc44 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:31 devstack sudo[101740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7.8577b1aa-d9cb-406a-9ed0-918a9bf0cc44
Nov 19 13:17:31 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:31 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b4ea3dc5-99e7-490f-b963-f4976a6fd3c9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.430s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:31 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-b4ea3dc5-99e7-490f-b963-f4976a6fd3c9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:17:31 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-b4ea3dc5-99e7-490f-b963-f4976a6fd3c9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Deleted volume successfully.
Nov 19 13:17:31 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b4ea3dc5-99e7-490f-b963-f4976a6fd3c9 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-0a5ee141-1147-4475-8899-f41cb71b613d-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:31 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ca0f0be7-39a8-45f8-afe8-51d5a2cb703c tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7.8577b1aa-d9cb-406a-9ed0-918a9bf0cc44" returned: 0 in 0.529s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-ca0f0be7-39a8-45f8-afe8-51d5a2cb703c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d244c9-04c2-46cb-8923-e68968d246a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:17:31 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81b45af-0867-41a5-b5c3-162156e4e51b]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:17:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ca0f0be7-39a8-45f8-afe8-51d5a2cb703c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:32 devstack sudo[101746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7
Nov 19 13:17:32 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:32 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ca0f0be7-39a8-45f8-afe8-51d5a2cb703c tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7" returned: 0 in 0.515s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ca0f0be7-39a8-45f8-afe8-51d5a2cb703c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7.8577b1aa-d9cb-406a-9ed0-918a9bf0cc44 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:32 devstack sudo[101751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7.8577b1aa-d9cb-406a-9ed0-918a9bf0cc44
Nov 19 13:17:32 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:32 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ca0f0be7-39a8-45f8-afe8-51d5a2cb703c tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7.8577b1aa-d9cb-406a-9ed0-918a9bf0cc44" returned: 0 in 0.453s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ca0f0be7-39a8-45f8-afe8-51d5a2cb703c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7.8577b1aa-d9cb-406a-9ed0-918a9bf0cc44 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:32 devstack sudo[101757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7.8577b1aa-d9cb-406a-9ed0-918a9bf0cc44
Nov 19 13:17:32 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:33 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ca0f0be7-39a8-45f8-afe8-51d5a2cb703c tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7.8577b1aa-d9cb-406a-9ed0-918a9bf0cc44" returned: 0 in 0.416s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-ca0f0be7-39a8-45f8-afe8-51d5a2cb703c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-quobyte-8577b1aa-d9cb-406a-9ed0-918a9bf0cc44" released by "_delete_snapshot" :: held 1.972s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-ca0f0be7-39a8-45f8-afe8-51d5a2cb703c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-quobyte-c4d244c9-04c2-46cb-8923-e68968d246a7" released by "delete_snapshot" :: held 1.982s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:33 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-ca0f0be7-39a8-45f8-afe8-51d5a2cb703c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Created reservations ['42ca628c-d49e-4ab8-89d8-c3c6225b05cb', '38438558-a376-4528-9edc-382b35f41fbb', 'cf85ec90-1874-46aa-a241-2a58874c8c26', '05d74318-9026-4bc5-ab59-c7396b3eb1a4'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:17:33 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-ca0f0be7-39a8-45f8-afe8-51d5a2cb703c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Delete snapshot completed successfully.
Nov 19 13:17:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-ca0f0be7-39a8-45f8-afe8-51d5a2cb703c tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-8577b1aa-d9cb-406a-9ed0-918a9bf0cc44-delete_snapshot" released by "delete_snapshot" :: held 2.065s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-58fb01c1-2f7e-41cd-9ef0-fae4a63cf638 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "cinder-c4d244c9-04c2-46cb-8923-e68968d246a7-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-58fb01c1-2f7e-41cd-9ef0-fae4a63cf638 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-c4d244c9-04c2-46cb-8923-e68968d246a7-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-58fb01c1-2f7e-41cd-9ef0-fae4a63cf638 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "cinder-quobyte-c4d244c9-04c2-46cb-8923-e68968d246a7" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:33 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-58fb01c1-2f7e-41cd-9ef0-fae4a63cf638 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-quobyte-c4d244c9-04c2-46cb-8923-e68968d246a7" acquired by "delete_volume" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:33 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec655655-672f-4608-af3b-21f6375a3afe]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:17:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-58fb01c1-2f7e-41cd-9ef0-fae4a63cf638 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:33 devstack sudo[101760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7
Nov 19 13:17:33 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:34 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-58fb01c1-2f7e-41cd-9ef0-fae4a63cf638 tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7" returned: 0 in 0.517s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-58fb01c1-2f7e-41cd-9ef0-fae4a63cf638 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:34 devstack sudo[101765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7
Nov 19 13:17:34 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:34 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-58fb01c1-2f7e-41cd-9ef0-fae4a63cf638 tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-c4d244c9-04c2-46cb-8923-e68968d246a7" returned: 0 in 0.416s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:34 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-58fb01c1-2f7e-41cd-9ef0-fae4a63cf638 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-quobyte-c4d244c9-04c2-46cb-8923-e68968d246a7" released by "delete_volume" :: held 0.959s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:34 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-58fb01c1-2f7e-41cd-9ef0-fae4a63cf638 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Created reservations ['58d82a92-b2ef-494c-b319-3a89c6a2dbf6', '3b611d2e-2877-47cd-be18-0a8c0ffc3353', '3ae93d0c-4f66-44c6-9269-96fa3a9dff09', 'a4e4a1a2-d616-44c1-8765-c1be36bb5682'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:17:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-58fb01c1-2f7e-41cd-9ef0-fae4a63cf638 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-58fb01c1-2f7e-41cd-9ef0-fae4a63cf638 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:34 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-58fb01c1-2f7e-41cd-9ef0-fae4a63cf638 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:17:34 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-58fb01c1-2f7e-41cd-9ef0-fae4a63cf638 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:17:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-58fb01c1-2f7e-41cd-9ef0-fae4a63cf638 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-58fb01c1-2f7e-41cd-9ef0-fae4a63cf638 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:34 devstack sudo[101768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:17:34 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:35 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-58fb01c1-2f7e-41cd-9ef0-fae4a63cf638 tempest-CreateVolumesFromSnapshotTest-2084197952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.454s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:35 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-58fb01c1-2f7e-41cd-9ef0-fae4a63cf638 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:17:35 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-58fb01c1-2f7e-41cd-9ef0-fae4a63cf638 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Deleted volume successfully.
Nov 19 13:17:35 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-58fb01c1-2f7e-41cd-9ef0-fae4a63cf638 tempest-CreateVolumesFromSnapshotTest-2084197952 None] Lock "cinder-c4d244c9-04c2-46cb-8923-e68968d246a7-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Flow 'volume_create_manager' (d428e02c-ab91-4265-a58a-a4491bdfd4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b8cd59-04b6-4574-a044-195bbec29d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b8cd59-04b6-4574-a044-195bbec29d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-467436741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c34b63b-a460-4ff0-9942-5f5335adae7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d872191d465f47dfa6a4e36649fccdbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:42Z,use_quota=True,user_id='af94c3af02fa41b7b5fc9e7dae74fcc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e5a317-62e0-4289-956e-94961d0066a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e5a317-62e0-4289-956e-94961d0066a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65e33012-68cc-4b7f-a827-455e02af2ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65e33012-68cc-4b7f-a827-455e02af2ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c34b63b-a460-4ff0-9942-5f5335adae7f', 'volume_name': 'volume-5c34b63b-a460-4ff0-9942-5f5335adae7f', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318b4c0f-ad8f-4b51-90fc-69bb44c54dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318b4c0f-ad8f-4b51-90fc-69bb44c54dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b581c1-6459-472f-b4de-978e34747e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:42 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Volume 5c34b63b-a460-4ff0-9942-5f5335adae7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c34b63b-a460-4ff0-9942-5f5335adae7f', 'volume_size': 1}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-467436741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c34b63b-a460-4ff0-9942-5f5335adae7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d872191d465f47dfa6a4e36649fccdbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:42Z,use_quota=True,user_id='af94c3af02fa41b7b5fc9e7dae74fcc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Creating volume 5c34b63b-a460-4ff0-9942-5f5335adae7f {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:17:42 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:42 devstack sudo[101863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f 1073741824
Nov 19 13:17:42 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Flow 'volume_create_manager' (a4b0119f-e98d-4c04-ae94-b46b4137afd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (925e3784-4177-4077-b9b4-4d8fc7fc9de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (925e3784-4177-4077-b9b4-4d8fc7fc9de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-642036842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4aefec-a859-46cb-a8df-f45b7f630bd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ce7076a19247b1835699beb219b7fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:42Z,use_quota=True,user_id='dd78e4382e2840ea955ce0577ef40a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3b37f2-0e21-4941-bc6d-aa6fae3feb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3b37f2-0e21-4941-bc6d-aa6fae3feb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (817e59a3-da29-4e25-b37e-afb4231885d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (817e59a3-da29-4e25-b37e-afb4231885d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec4aefec-a859-46cb-a8df-f45b7f630bd7', 'volume_name': 'volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0cc27e-23f6-4178-b2d5-f044c5395dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0cc27e-23f6-4178-b2d5-f044c5395dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10592f4e-09c3-4dda-9d43-0fecf1b8633b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:42 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Volume ec4aefec-a859-46cb-a8df-f45b7f630bd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7', 'volume_size': 1}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Flow 'volume_create_manager' (07081b1e-cbe3-42d7-a97d-3e9815f5af44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7531bcbd-452c-4c7e-bef9-5f1dc9db536f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7531bcbd-452c-4c7e-bef9-5f1dc9db536f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1229842730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee85fd57-a4b0-497a-8992-0ff3bc9db81f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f079be7e56474745958703acc751e614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:42Z,use_quota=True,user_id='16b033482fd54fd4b08d014edc4dae06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ed0051-8c3a-4c98-b99e-9e13173b0121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ed0051-8c3a-4c98-b99e-9e13173b0121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f328c9d5-1492-43d4-a8fc-72661133447c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f328c9d5-1492-43d4-a8fc-72661133447c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee85fd57-a4b0-497a-8992-0ff3bc9db81f', 'volume_name': 'volume-ee85fd57-a4b0-497a-8992-0ff3bc9db81f', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3547c363-74db-421d-be4b-9beabaaa9231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3547c363-74db-421d-be4b-9beabaaa9231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315600bc-cf8a-464a-a42c-b582525040d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:42 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Volume ee85fd57-a4b0-497a-8992-0ff3bc9db81f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee85fd57-a4b0-497a-8992-0ff3bc9db81f', 'volume_size': 1}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Flow 'volume_create_manager' (1b099b26-f1a0-4fc6-a790-073a42ed4b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa39e67a-c1c8-4bc8-b058-9a12e0efd097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa39e67a-c1c8-4bc8-b058-9a12e0efd097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1613621734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71014b0b-51c0-4251-adfe-6b7285a0c216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f079be7e56474745958703acc751e614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:42Z,use_quota=True,user_id='16b033482fd54fd4b08d014edc4dae06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (114c9a72-3eff-47b1-b23c-046a057f6a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (114c9a72-3eff-47b1-b23c-046a057f6a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd35b1a6-1c75-4ebf-b334-bf5c808cff32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd35b1a6-1c75-4ebf-b334-bf5c808cff32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71014b0b-51c0-4251-adfe-6b7285a0c216', 'volume_name': 'volume-71014b0b-51c0-4251-adfe-6b7285a0c216', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0636cf6b-d6d1-48f7-ac4e-98c395a2c031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0636cf6b-d6d1-48f7-ac4e-98c395a2c031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (946a4dac-008a-42b4-b629-5ef82d5ea356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:42 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Volume 71014b0b-51c0-4251-adfe-6b7285a0c216: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71014b0b-51c0-4251-adfe-6b7285a0c216', 'volume_size': 1}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Flow 'volume_create_manager' (96f5a887-840d-4c1b-bc01-ebfdf280b596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf39402b-7e32-45fa-88b8-671050ac9e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf39402b-7e32-45fa-88b8-671050ac9e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-331791102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48296cfd-8763-49b4-9cda-1063c7a2cba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f079be7e56474745958703acc751e614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:43Z,use_quota=True,user_id='16b033482fd54fd4b08d014edc4dae06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804bf10d-71d9-4465-b56d-75ccb84424f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804bf10d-71d9-4465-b56d-75ccb84424f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0be08d7-842a-4045-a7f4-3307247cac3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0be08d7-842a-4045-a7f4-3307247cac3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48296cfd-8763-49b4-9cda-1063c7a2cba0', 'volume_name': 'volume-48296cfd-8763-49b4-9cda-1063c7a2cba0', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a369d6-cf70-455e-b2fc-53b4196b7f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a369d6-cf70-455e-b2fc-53b4196b7f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daaff733-e458-4a69-b797-f12ab4250891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:42 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Volume 48296cfd-8763-49b4-9cda-1063c7a2cba0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48296cfd-8763-49b4-9cda-1063c7a2cba0', 'volume_size': 1}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:42 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f 1073741824" returned: 0 in 0.754s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:42 devstack sudo[101868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f
Nov 19 13:17:42 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Flow 'volume_create_manager' (a30af871-9631-4561-985e-ca00f1bbd42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:42 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0775bb51-60cc-4fe7-b152-b122798477a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0775bb51-60cc-4fe7-b152-b122798477a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-746134099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0d0445-59ac-472e-8194-1aa41fbe4298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f079be7e56474745958703acc751e614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:43Z,use_quota=True,user_id='16b033482fd54fd4b08d014edc4dae06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1fa22c-b7d6-432e-a491-13f67015cee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1fa22c-b7d6-432e-a491-13f67015cee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ec532a-b279-432f-8118-3d26e5c640f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ec532a-b279-432f-8118-3d26e5c640f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da0d0445-59ac-472e-8194-1aa41fbe4298', 'volume_name': 'volume-da0d0445-59ac-472e-8194-1aa41fbe4298', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0c1532-1c83-4f4a-b801-95fdbfcc25a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0c1532-1c83-4f4a-b801-95fdbfcc25a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9421957b-2e8e-4ade-980d-038f6a19269b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:43 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Volume da0d0445-59ac-472e-8194-1aa41fbe4298: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da0d0445-59ac-472e-8194-1aa41fbe4298', 'volume_size': 1}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Flow 'volume_create_manager' (6a66ea3a-cb3f-4319-aa65-5a0261e65ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62af6599-995f-4c7e-bfed-9671d6980cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62af6599-995f-4c7e-bfed-9671d6980cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-848129404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3754704-b638-4058-b5d9-8c6013afa293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f079be7e56474745958703acc751e614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:43Z,use_quota=True,user_id='16b033482fd54fd4b08d014edc4dae06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f61e20-b3ae-4e28-b805-10fd1434d8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f61e20-b3ae-4e28-b805-10fd1434d8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd237a3-9805-429a-a52f-c0c51cef713d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd237a3-9805-429a-a52f-c0c51cef713d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3754704-b638-4058-b5d9-8c6013afa293', 'volume_name': 'volume-b3754704-b638-4058-b5d9-8c6013afa293', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f7e7f1f-b467-4a54-8ceb-db1541941f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f7e7f1f-b467-4a54-8ceb-db1541941f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca96fd7-4de5-45b2-8be5-87bd90a14fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:43 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Volume b3754704-b638-4058-b5d9-8c6013afa293: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3754704-b638-4058-b5d9-8c6013afa293', 'volume_size': 1}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:43 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f" returned: 0 in 0.533s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.115s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-642036842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4aefec-a859-46cb-a8df-f45b7f630bd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ce7076a19247b1835699beb219b7fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:42Z,use_quota=True,user_id='dd78e4382e2840ea955ce0577ef40a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Creating volume ec4aefec-a859-46cb-a8df-f45b7f630bd7 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:17:43 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b581c1-6459-472f-b4de-978e34747e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c34b63b-a460-4ff0-9942-5f5335adae7f', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:43 devstack sudo[101872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7 1073741824
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e8b3eb-da84-43ba-813c-4251d3eec4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:43 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:43 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Volume volume-5c34b63b-a460-4ff0-9942-5f5335adae7f (5c34b63b-a460-4ff0-9942-5f5335adae7f): created successfully
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e8b3eb-da84-43ba-813c-4251d3eec4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Flow 'volume_create_manager' (d428e02c-ab91-4265-a58a-a4491bdfd4fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:43 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-c06aeac9-4df1-4720-9da7-631f285bbec9 tempest-VolumeDependencyTests-1207279966 None] Created volume successfully.
Nov 19 13:17:43 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7 1073741824" returned: 0 in 0.568s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:43 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:43 devstack sudo[101877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7
Nov 19 13:17:43 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-967a5535-4421-4204-83c4-4ff8e818bc25 tempest-VolumeDependencyTests-1207279966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:44 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7" returned: 0 in 0.490s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:44 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:17:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.079s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:44 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1229842730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee85fd57-a4b0-497a-8992-0ff3bc9db81f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f079be7e56474745958703acc751e614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:42Z,use_quota=True,user_id='16b033482fd54fd4b08d014edc4dae06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:17:44 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Creating volume ee85fd57-a4b0-497a-8992-0ff3bc9db81f {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:17:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:44 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:17:44 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:17:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:44 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:17:44 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:17:44 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee85fd57-a4b0-497a-8992-0ff3bc9db81f 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10592f4e-09c3-4dda-9d43-0fecf1b8633b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:44 devstack sudo[101880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee85fd57-a4b0-497a-8992-0ff3bc9db81f 1073741824
Nov 19 13:17:44 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67b6809-04f0-41d5-89a4-d453666c20e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:44 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Volume volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7 (ec4aefec-a859-46cb-a8df-f45b7f630bd7): created successfully
Nov 19 13:17:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67b6809-04f0-41d5-89a4-d453666c20e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:44 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Flow 'volume_create_manager' (a4b0119f-e98d-4c04-ae94-b46b4137afd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:44 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-23b37d66-0174-4288-bc15-51d1144261ca tempest-CreateVolumesFromSnapshotTest-287984160 None] Created volume successfully.
Nov 19 13:17:45 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee85fd57-a4b0-497a-8992-0ff3bc9db81f 1073741824" returned: 0 in 0.562s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee85fd57-a4b0-497a-8992-0ff3bc9db81f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:45 devstack sudo[101885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee85fd57-a4b0-497a-8992-0ff3bc9db81f
Nov 19 13:17:45 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-278e4dd2-e088-40b5-86d5-96cedfdc5c00 tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:45 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee85fd57-a4b0-497a-8992-0ff3bc9db81f" returned: 0 in 0.521s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:45 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:17:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.009s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:45 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1613621734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71014b0b-51c0-4251-adfe-6b7285a0c216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f079be7e56474745958703acc751e614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:42Z,use_quota=True,user_id='16b033482fd54fd4b08d014edc4dae06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:17:45 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Creating volume 71014b0b-51c0-4251-adfe-6b7285a0c216 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:17:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:45 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:17:45 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:17:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:45 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:17:45 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:17:45 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-71014b0b-51c0-4251-adfe-6b7285a0c216 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315600bc-cf8a-464a-a42c-b582525040d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee85fd57-a4b0-497a-8992-0ff3bc9db81f', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7bc1b1b-b530-44a1-bf4b-dab1b7e2048d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:45 devstack sudo[101888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-71014b0b-51c0-4251-adfe-6b7285a0c216 1073741824
Nov 19 13:17:45 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:45 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Volume volume-ee85fd57-a4b0-497a-8992-0ff3bc9db81f (ee85fd57-a4b0-497a-8992-0ff3bc9db81f): created successfully
Nov 19 13:17:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7bc1b1b-b530-44a1-bf4b-dab1b7e2048d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:45 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Flow 'volume_create_manager' (07081b1e-cbe3-42d7-a97d-3e9815f5af44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:45 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-c611473e-72d1-4db4-bcac-4e1222b22a72 tempest-CreateVolumesFromImageTest-958260192 None] Created volume successfully.
Nov 19 13:17:46 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-71014b0b-51c0-4251-adfe-6b7285a0c216 1073741824" returned: 0 in 0.633s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-71014b0b-51c0-4251-adfe-6b7285a0c216 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:46 devstack sudo[101893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-71014b0b-51c0-4251-adfe-6b7285a0c216
Nov 19 13:17:46 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:46 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-71014b0b-51c0-4251-adfe-6b7285a0c216" returned: 0 in 0.527s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:46 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:17:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.944s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:46 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-331791102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48296cfd-8763-49b4-9cda-1063c7a2cba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f079be7e56474745958703acc751e614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:43Z,use_quota=True,user_id='16b033482fd54fd4b08d014edc4dae06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:17:46 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Creating volume 48296cfd-8763-49b4-9cda-1063c7a2cba0 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:17:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:46 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:17:46 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:17:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:46 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:17:46 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:17:46 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-48296cfd-8763-49b4-9cda-1063c7a2cba0 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (946a4dac-008a-42b4-b629-5ef82d5ea356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71014b0b-51c0-4251-adfe-6b7285a0c216', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20655f78-63c9-464a-9c66-c78985404e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:46 devstack sudo[101896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-48296cfd-8763-49b4-9cda-1063c7a2cba0 1073741824
Nov 19 13:17:46 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:46 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Volume volume-71014b0b-51c0-4251-adfe-6b7285a0c216 (71014b0b-51c0-4251-adfe-6b7285a0c216): created successfully
Nov 19 13:17:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20655f78-63c9-464a-9c66-c78985404e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:46 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Flow 'volume_create_manager' (1b099b26-f1a0-4fc6-a790-073a42ed4b0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:46 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-32a13248-ced9-460b-95ff-631cc4734a5a tempest-CreateVolumesFromImageTest-958260192 None] Created volume successfully.
Nov 19 13:17:47 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-48296cfd-8763-49b4-9cda-1063c7a2cba0 1073741824" returned: 0 in 0.549s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-48296cfd-8763-49b4-9cda-1063c7a2cba0 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:47 devstack sudo[101901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-48296cfd-8763-49b4-9cda-1063c7a2cba0
Nov 19 13:17:47 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:47 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-48296cfd-8763-49b4-9cda-1063c7a2cba0" returned: 0 in 0.515s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:17:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.779s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-746134099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0d0445-59ac-472e-8194-1aa41fbe4298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f079be7e56474745958703acc751e614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:43Z,use_quota=True,user_id='16b033482fd54fd4b08d014edc4dae06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:17:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Creating volume da0d0445-59ac-472e-8194-1aa41fbe4298 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:17:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:17:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:17:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:47 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:17:47 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:17:47 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da0d0445-59ac-472e-8194-1aa41fbe4298 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daaff733-e458-4a69-b797-f12ab4250891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48296cfd-8763-49b4-9cda-1063c7a2cba0', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:47 devstack sudo[101904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da0d0445-59ac-472e-8194-1aa41fbe4298 1073741824
Nov 19 13:17:47 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0701446a-ff5d-460a-a341-c7aaf2414fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:47 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Volume volume-48296cfd-8763-49b4-9cda-1063c7a2cba0 (48296cfd-8763-49b4-9cda-1063c7a2cba0): created successfully
Nov 19 13:17:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0701446a-ff5d-460a-a341-c7aaf2414fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:47 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Flow 'volume_create_manager' (96f5a887-840d-4c1b-bc01-ebfdf280b596) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:47 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-6746dd8c-cd0e-4394-81fc-68bc57026b9d tempest-CreateVolumesFromImageTest-958260192 None] Created volume successfully.
Nov 19 13:17:48 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da0d0445-59ac-472e-8194-1aa41fbe4298 1073741824" returned: 0 in 0.590s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da0d0445-59ac-472e-8194-1aa41fbe4298 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:48 devstack sudo[101909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da0d0445-59ac-472e-8194-1aa41fbe4298
Nov 19 13:17:48 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:48 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da0d0445-59ac-472e-8194-1aa41fbe4298" returned: 0 in 0.460s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:48 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:17:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.585s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:48 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-848129404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3754704-b638-4058-b5d9-8c6013afa293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f079be7e56474745958703acc751e614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:43Z,use_quota=True,user_id='16b033482fd54fd4b08d014edc4dae06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:17:48 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Creating volume b3754704-b638-4058-b5d9-8c6013afa293 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:17:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:48 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:17:48 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:17:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:48 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:17:48 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:17:48 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b3754704-b638-4058-b5d9-8c6013afa293 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9421957b-2e8e-4ade-980d-038f6a19269b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da0d0445-59ac-472e-8194-1aa41fbe4298', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c369463-aae6-4917-8fee-73ca68681bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:48 devstack sudo[101912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b3754704-b638-4058-b5d9-8c6013afa293 1073741824
Nov 19 13:17:48 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:48 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Volume volume-da0d0445-59ac-472e-8194-1aa41fbe4298 (da0d0445-59ac-472e-8194-1aa41fbe4298): created successfully
Nov 19 13:17:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c369463-aae6-4917-8fee-73ca68681bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:48 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Flow 'volume_create_manager' (a30af871-9631-4561-985e-ca00f1bbd42e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:48 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-95e3d50e-80e2-49f1-9e99-61f95cfc47fa tempest-CreateVolumesFromImageTest-958260192 None] Created volume successfully.
Nov 19 13:17:49 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b3754704-b638-4058-b5d9-8c6013afa293 1073741824" returned: 0 in 0.621s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b3754704-b638-4058-b5d9-8c6013afa293 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:49 devstack sudo[101917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b3754704-b638-4058-b5d9-8c6013afa293
Nov 19 13:17:49 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:49 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b3754704-b638-4058-b5d9-8c6013afa293" returned: 0 in 0.411s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:49 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:17:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-967a5535-4421-4204-83c4-4ff8e818bc25 tempest-VolumeDependencyTests-1207279966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.631s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca96fd7-4de5-45b2-8be5-87bd90a14fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3754704-b638-4058-b5d9-8c6013afa293', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bcc580e-bbca-4855-b346-b010240ad91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:49 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-967a5535-4421-4204-83c4-4ff8e818bc25 tempest-VolumeDependencyTests-1207279966 None] Creating offline snapshot 0acf9e49-c636-402b-9f67-50bd15ca406c of volume 5c34b63b-a460-4ff0-9942-5f5335adae7f {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 13:17:49 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Volume volume-b3754704-b638-4058-b5d9-8c6013afa293 (b3754704-b638-4058-b5d9-8c6013afa293): created successfully
Nov 19 13:17:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bcc580e-bbca-4855-b346-b010240ad91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:49 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Flow 'volume_create_manager' (6a66ea3a-cb3f-4319-aa65-5a0261e65ba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:49 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e7eb31-e9da-4d16-871a-6e38e02357e0]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:17:49 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-967a5535-4421-4204-83c4-4ff8e818bc25 tempest-VolumeDependencyTests-1207279966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:49 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-91855677-925e-49c4-ad09-0405ddc0f64a tempest-CreateVolumesFromImageTest-958260192 None] Created volume successfully.
Nov 19 13:17:50 devstack sudo[101920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f
Nov 19 13:17:50 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:50 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-967a5535-4421-4204-83c4-4ff8e818bc25 tempest-VolumeDependencyTests-1207279966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f" returned: 0 in 0.589s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:50 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-967a5535-4421-4204-83c4-4ff8e818bc25 tempest-VolumeDependencyTests-1207279966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.0acf9e49-c636-402b-9f67-50bd15ca406c 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:50 devstack sudo[101925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.0acf9e49-c636-402b-9f67-50bd15ca406c 1G
Nov 19 13:17:50 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:50 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6837c197-3630-42e0-9ba6-84fc17490571 tempest-CreateVolumesFromImageTest-958260192 None] Acquiring lock "cinder-b3754704-b638-4058-b5d9-8c6013afa293-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:50 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6837c197-3630-42e0-9ba6-84fc17490571 tempest-CreateVolumesFromImageTest-958260192 None] Lock "cinder-b3754704-b638-4058-b5d9-8c6013afa293-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:50 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6837c197-3630-42e0-9ba6-84fc17490571 tempest-CreateVolumesFromImageTest-958260192 None] Acquiring lock "cinder-quobyte-b3754704-b638-4058-b5d9-8c6013afa293" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:50 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6837c197-3630-42e0-9ba6-84fc17490571 tempest-CreateVolumesFromImageTest-958260192 None] Lock "cinder-quobyte-b3754704-b638-4058-b5d9-8c6013afa293" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:51 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a9b361-5f32-4c46-9f12-503548201c02]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:17:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6837c197-3630-42e0-9ba6-84fc17490571 tempest-CreateVolumesFromImageTest-958260192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b3754704-b638-4058-b5d9-8c6013afa293 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:51 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-967a5535-4421-4204-83c4-4ff8e818bc25 tempest-VolumeDependencyTests-1207279966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.0acf9e49-c636-402b-9f67-50bd15ca406c 1G" returned: 0 in 0.574s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-967a5535-4421-4204-83c4-4ff8e818bc25 tempest-VolumeDependencyTests-1207279966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c34b63b-a460-4ff0-9942-5f5335adae7f -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.0acf9e49-c636-402b-9f67-50bd15ca406c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:51 devstack sudo[101930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b3754704-b638-4058-b5d9-8c6013afa293
Nov 19 13:17:51 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:51 devstack sudo[101931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c34b63b-a460-4ff0-9942-5f5335adae7f -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.0acf9e49-c636-402b-9f67-50bd15ca406c
Nov 19 13:17:51 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:51 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:51 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-967a5535-4421-4204-83c4-4ff8e818bc25 tempest-VolumeDependencyTests-1207279966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c34b63b-a460-4ff0-9942-5f5335adae7f -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.0acf9e49-c636-402b-9f67-50bd15ca406c" returned: 0 in 0.570s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:51 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-967a5535-4421-4204-83c4-4ff8e818bc25 tempest-VolumeDependencyTests-1207279966 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.0acf9e49-c636-402b-9f67-50bd15ca406c is being set with open permissions: ugo+rw
Nov 19 13:17:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-967a5535-4421-4204-83c4-4ff8e818bc25 tempest-VolumeDependencyTests-1207279966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.0acf9e49-c636-402b-9f67-50bd15ca406c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6837c197-3630-42e0-9ba6-84fc17490571 tempest-CreateVolumesFromImageTest-958260192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b3754704-b638-4058-b5d9-8c6013afa293" returned: 0 in 0.713s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:51 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6837c197-3630-42e0-9ba6-84fc17490571 tempest-CreateVolumesFromImageTest-958260192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b3754704-b638-4058-b5d9-8c6013afa293 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:51 devstack sudo[101940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.0acf9e49-c636-402b-9f67-50bd15ca406c
Nov 19 13:17:51 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:51 devstack sudo[101941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b3754704-b638-4058-b5d9-8c6013afa293
Nov 19 13:17:51 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:52 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-967a5535-4421-4204-83c4-4ff8e818bc25 tempest-VolumeDependencyTests-1207279966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.0acf9e49-c636-402b-9f67-50bd15ca406c" returned: 0 in 0.471s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-967a5535-4421-4204-83c4-4ff8e818bc25 tempest-VolumeDependencyTests-1207279966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:52 devstack sudo[101946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.info
Nov 19 13:17:52 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:52 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6837c197-3630-42e0-9ba6-84fc17490571 tempest-CreateVolumesFromImageTest-958260192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-b3754704-b638-4058-b5d9-8c6013afa293" returned: 0 in 0.525s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:52 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6837c197-3630-42e0-9ba6-84fc17490571 tempest-CreateVolumesFromImageTest-958260192 None] Lock "cinder-quobyte-b3754704-b638-4058-b5d9-8c6013afa293" released by "delete_volume" :: held 1.266s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:52 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-6837c197-3630-42e0-9ba6-84fc17490571 tempest-CreateVolumesFromImageTest-958260192 None] Created reservations ['64b4f844-7203-4cff-ab25-6ca1791cd396', '1b2c28b4-7af8-4f95-8588-689a5af4307e', '6e6d3324-17c6-4c98-afea-a7925454c981', 'de98d1dd-efe2-4ed9-a16c-08843fb9718f'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:17:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6837c197-3630-42e0-9ba6-84fc17490571 tempest-CreateVolumesFromImageTest-958260192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6837c197-3630-42e0-9ba6-84fc17490571 tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6837c197-3630-42e0-9ba6-84fc17490571 tempest-CreateVolumesFromImageTest-958260192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:17:52 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6837c197-3630-42e0-9ba6-84fc17490571 tempest-CreateVolumesFromImageTest-958260192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:17:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6837c197-3630-42e0-9ba6-84fc17490571 tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6837c197-3630-42e0-9ba6-84fc17490571 tempest-CreateVolumesFromImageTest-958260192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:52 devstack sudo[101948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:17:52 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:52 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-967a5535-4421-4204-83c4-4ff8e818bc25 tempest-VolumeDependencyTests-1207279966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.info" returned: 0 in 0.637s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:52 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-967a5535-4421-4204-83c4-4ff8e818bc25 tempest-VolumeDependencyTests-1207279966 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.info is being set with open permissions: ugo+rw
Nov 19 13:17:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-967a5535-4421-4204-83c4-4ff8e818bc25 tempest-VolumeDependencyTests-1207279966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:52 devstack sudo[101954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.info
Nov 19 13:17:52 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:52 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:52 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6837c197-3630-42e0-9ba6-84fc17490571 tempest-CreateVolumesFromImageTest-958260192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.544s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:52 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-6837c197-3630-42e0-9ba6-84fc17490571 tempest-CreateVolumesFromImageTest-958260192 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:17:52 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-6837c197-3630-42e0-9ba6-84fc17490571 tempest-CreateVolumesFromImageTest-958260192 None] Deleted volume successfully.
Nov 19 13:17:52 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6837c197-3630-42e0-9ba6-84fc17490571 tempest-CreateVolumesFromImageTest-958260192 None] Lock "cinder-b3754704-b638-4058-b5d9-8c6013afa293-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:53 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5d243371-fb30-493c-951b-fea84a1c702a tempest-CreateVolumesFromImageTest-958260192 None] Acquiring lock "cinder-da0d0445-59ac-472e-8194-1aa41fbe4298-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:53 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5d243371-fb30-493c-951b-fea84a1c702a tempest-CreateVolumesFromImageTest-958260192 None] Lock "cinder-da0d0445-59ac-472e-8194-1aa41fbe4298-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:53 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5d243371-fb30-493c-951b-fea84a1c702a tempest-CreateVolumesFromImageTest-958260192 None] Acquiring lock "cinder-quobyte-da0d0445-59ac-472e-8194-1aa41fbe4298" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:53 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5d243371-fb30-493c-951b-fea84a1c702a tempest-CreateVolumesFromImageTest-958260192 None] Lock "cinder-quobyte-da0d0445-59ac-472e-8194-1aa41fbe4298" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:53 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4bce83-d44a-4f75-a606-6abdf7f4a693]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:17:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5d243371-fb30-493c-951b-fea84a1c702a tempest-CreateVolumesFromImageTest-958260192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da0d0445-59ac-472e-8194-1aa41fbe4298 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:53 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-967a5535-4421-4204-83c4-4ff8e818bc25 tempest-VolumeDependencyTests-1207279966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.info" returned: 0 in 0.496s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-967a5535-4421-4204-83c4-4ff8e818bc25 tempest-VolumeDependencyTests-1207279966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.413s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-278e4dd2-e088-40b5-86d5-96cedfdc5c00 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.027s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:53 devstack sudo[101958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da0d0445-59ac-472e-8194-1aa41fbe4298
Nov 19 13:17:53 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:53 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-278e4dd2-e088-40b5-86d5-96cedfdc5c00 tempest-CreateVolumesFromSnapshotTest-287984160 None] Creating offline snapshot 388bea36-15d0-4f18-8080-894ddfa69756 of volume ec4aefec-a859-46cb-a8df-f45b7f630bd7 {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 13:17:53 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-967a5535-4421-4204-83c4-4ff8e818bc25 tempest-VolumeDependencyTests-1207279966 None] Create snapshot completed successfully
Nov 19 13:17:53 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[85804fa5-7177-40e8-86ad-1e72b7fbf7ea]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:17:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-278e4dd2-e088-40b5-86d5-96cedfdc5c00 tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:53 devstack sudo[101960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7
Nov 19 13:17:53 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:53 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5d243371-fb30-493c-951b-fea84a1c702a tempest-CreateVolumesFromImageTest-958260192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da0d0445-59ac-472e-8194-1aa41fbe4298" returned: 0 in 0.707s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:53 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5d243371-fb30-493c-951b-fea84a1c702a tempest-CreateVolumesFromImageTest-958260192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da0d0445-59ac-472e-8194-1aa41fbe4298 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:54 devstack sudo[101965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da0d0445-59ac-472e-8194-1aa41fbe4298
Nov 19 13:17:54 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Flow 'volume_create_manager' (62583e71-2f54-4e61-926c-9dae58d80cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777a4cbc-5898-4e7f-a042-2b7953cae7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777a4cbc-5898-4e7f-a042-2b7953cae7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1182414173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc07a169-fdb0-4df6-9104-e209b9a7d92b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d872191d465f47dfa6a4e36649fccdbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0acf9e49-c636-402b-9f67-50bd15ca406c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:54Z,use_quota=True,user_id='af94c3af02fa41b7b5fc9e7dae74fcc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a49808-040c-41d4-9f2b-4d31a859bad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a49808-040c-41d4-9f2b-4d31a859bad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:54 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215fc9b6-b592-45a8-8e93-ce464cef0fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215fc9b6-b592-45a8-8e93-ce464cef0fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cc07a169-fdb0-4df6-9104-e209b9a7d92b', 'volume_name': 'volume-cc07a169-fdb0-4df6-9104-e209b9a7d92b', 'volume_size': 1, 'snapshot_id': '0acf9e49-c636-402b-9f67-50bd15ca406c'}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (604dec39-c15f-450a-ad0a-02b8119e1092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (604dec39-c15f-450a-ad0a-02b8119e1092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef91709-2248-4eeb-bff1-f46bcb046663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:54 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Volume cc07a169-fdb0-4df6-9104-e209b9a7d92b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cc07a169-fdb0-4df6-9104-e209b9a7d92b', 'volume_size': 1, 'snapshot_id': '0acf9e49-c636-402b-9f67-50bd15ca406c'}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-278e4dd2-e088-40b5-86d5-96cedfdc5c00 tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7" returned: 0 in 0.710s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-278e4dd2-e088-40b5-86d5-96cedfdc5c00 tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7.388bea36-15d0-4f18-8080-894ddfa69756 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:54 devstack sudo[101970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7.388bea36-15d0-4f18-8080-894ddfa69756 1G
Nov 19 13:17:54 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Flow 'volume_create_manager' (9cbf6cd1-47d5-497d-b872-ffdc5420e326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06542aa3-ca18-4274-97c3-482ebfe51cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06542aa3-ca18-4274-97c3-482ebfe51cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-453789027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1ec2305-6bae-42a7-9220-5547071969cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e81e4ca6024ff2b2ce87d0811adb36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:54Z,use_quota=True,user_id='ca34ddd87c9a4c2eac433a3c13b9952b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fc93b3-a209-4aa5-9730-8b907f798cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fc93b3-a209-4aa5-9730-8b907f798cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab22906-76d3-4963-870a-3768b12db8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab22906-76d3-4963-870a-3768b12db8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1ec2305-6bae-42a7-9220-5547071969cc', 'volume_name': 'volume-a1ec2305-6bae-42a7-9220-5547071969cc', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc9d106-ac85-4f00-a4fd-989089890ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc9d106-ac85-4f00-a4fd-989089890ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f237f71-824a-44c5-843d-daeb6fff8bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:54 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Volume a1ec2305-6bae-42a7-9220-5547071969cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1ec2305-6bae-42a7-9220-5547071969cc', 'volume_size': 1}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:54 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5d243371-fb30-493c-951b-fea84a1c702a tempest-CreateVolumesFromImageTest-958260192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-da0d0445-59ac-472e-8194-1aa41fbe4298" returned: 0 in 0.543s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5d243371-fb30-493c-951b-fea84a1c702a tempest-CreateVolumesFromImageTest-958260192 None] Lock "cinder-quobyte-da0d0445-59ac-472e-8194-1aa41fbe4298" released by "delete_volume" :: held 1.277s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-5d243371-fb30-493c-951b-fea84a1c702a tempest-CreateVolumesFromImageTest-958260192 None] Created reservations ['6f8301f6-ffcf-446f-849e-9aede164d036', '631ffcc1-0aa5-43df-874d-04e2f6413a68', 'b1e5f353-3533-4c4d-9eae-21de6f887797', '3e279e9c-4625-4295-ab88-e8ef76b216f7'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5d243371-fb30-493c-951b-fea84a1c702a tempest-CreateVolumesFromImageTest-958260192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5d243371-fb30-493c-951b-fea84a1c702a tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5d243371-fb30-493c-951b-fea84a1c702a tempest-CreateVolumesFromImageTest-958260192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5d243371-fb30-493c-951b-fea84a1c702a tempest-CreateVolumesFromImageTest-958260192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5d243371-fb30-493c-951b-fea84a1c702a tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5d243371-fb30-493c-951b-fea84a1c702a tempest-CreateVolumesFromImageTest-958260192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:54 devstack sudo[101976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:17:54 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:54 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-278e4dd2-e088-40b5-86d5-96cedfdc5c00 tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7.388bea36-15d0-4f18-8080-894ddfa69756 1G" returned: 0 in 0.559s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:54 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-278e4dd2-e088-40b5-86d5-96cedfdc5c00 tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7.388bea36-15d0-4f18-8080-894ddfa69756 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:54 devstack sudo[101978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7.388bea36-15d0-4f18-8080-894ddfa69756
Nov 19 13:17:54 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:55 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5d243371-fb30-493c-951b-fea84a1c702a tempest-CreateVolumesFromImageTest-958260192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.510s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:55 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-5d243371-fb30-493c-951b-fea84a1c702a tempest-CreateVolumesFromImageTest-958260192 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:17:55 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-5d243371-fb30-493c-951b-fea84a1c702a tempest-CreateVolumesFromImageTest-958260192 None] Deleted volume successfully.
Nov 19 13:17:55 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5d243371-fb30-493c-951b-fea84a1c702a tempest-CreateVolumesFromImageTest-958260192 None] Lock "cinder-da0d0445-59ac-472e-8194-1aa41fbe4298-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:55 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-278e4dd2-e088-40b5-86d5-96cedfdc5c00 tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7.388bea36-15d0-4f18-8080-894ddfa69756" returned: 0 in 0.509s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:55 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-278e4dd2-e088-40b5-86d5-96cedfdc5c00 tempest-CreateVolumesFromSnapshotTest-287984160 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7.388bea36-15d0-4f18-8080-894ddfa69756 is being set with open permissions: ugo+rw
Nov 19 13:17:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-278e4dd2-e088-40b5-86d5-96cedfdc5c00 tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7.388bea36-15d0-4f18-8080-894ddfa69756 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:55 devstack sudo[101984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7.388bea36-15d0-4f18-8080-894ddfa69756
Nov 19 13:17:55 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:55 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f4001641-7dba-4212-882b-02616d53dc97 tempest-CreateVolumesFromImageTest-958260192 None] Acquiring lock "cinder-48296cfd-8763-49b4-9cda-1063c7a2cba0-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:55 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f4001641-7dba-4212-882b-02616d53dc97 tempest-CreateVolumesFromImageTest-958260192 None] Lock "cinder-48296cfd-8763-49b4-9cda-1063c7a2cba0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:55 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f4001641-7dba-4212-882b-02616d53dc97 tempest-CreateVolumesFromImageTest-958260192 None] Acquiring lock "cinder-quobyte-48296cfd-8763-49b4-9cda-1063c7a2cba0" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:55 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f4001641-7dba-4212-882b-02616d53dc97 tempest-CreateVolumesFromImageTest-958260192 None] Lock "cinder-quobyte-48296cfd-8763-49b4-9cda-1063c7a2cba0" acquired by "delete_volume" :: waited 0.018s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:55 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fe2213-4ec6-4147-aff4-229d429354d0]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:17:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f4001641-7dba-4212-882b-02616d53dc97 tempest-CreateVolumesFromImageTest-958260192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-48296cfd-8763-49b4-9cda-1063c7a2cba0 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:55 devstack sudo[101986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-48296cfd-8763-49b4-9cda-1063c7a2cba0
Nov 19 13:17:55 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:55 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-278e4dd2-e088-40b5-86d5-96cedfdc5c00 tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7.388bea36-15d0-4f18-8080-894ddfa69756" returned: 0 in 0.563s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:55 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-278e4dd2-e088-40b5-86d5-96cedfdc5c00 tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:55 devstack sudo[101989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7.info
Nov 19 13:17:55 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:56 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f4001641-7dba-4212-882b-02616d53dc97 tempest-CreateVolumesFromImageTest-958260192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-48296cfd-8763-49b4-9cda-1063c7a2cba0" returned: 0 in 0.576s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f4001641-7dba-4212-882b-02616d53dc97 tempest-CreateVolumesFromImageTest-958260192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-48296cfd-8763-49b4-9cda-1063c7a2cba0 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:56 devstack sudo[101995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-48296cfd-8763-49b4-9cda-1063c7a2cba0
Nov 19 13:17:56 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:56 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-278e4dd2-e088-40b5-86d5-96cedfdc5c00 tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7.info" returned: 0 in 0.494s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:56 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-278e4dd2-e088-40b5-86d5-96cedfdc5c00 tempest-CreateVolumesFromSnapshotTest-287984160 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7.info is being set with open permissions: ugo+rw
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-278e4dd2-e088-40b5-86d5-96cedfdc5c00 tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:56 devstack sudo[101998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7.info
Nov 19 13:17:56 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:56 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f4001641-7dba-4212-882b-02616d53dc97 tempest-CreateVolumesFromImageTest-958260192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-48296cfd-8763-49b4-9cda-1063c7a2cba0" returned: 0 in 0.415s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f4001641-7dba-4212-882b-02616d53dc97 tempest-CreateVolumesFromImageTest-958260192 None] Lock "cinder-quobyte-48296cfd-8763-49b4-9cda-1063c7a2cba0" released by "delete_volume" :: held 1.015s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-f4001641-7dba-4212-882b-02616d53dc97 tempest-CreateVolumesFromImageTest-958260192 None] Created reservations ['40f67a5c-0086-44fc-8d4c-ab100bb97078', '3a50c531-7446-4565-9ee2-e873686a85d6', '81e08be9-b52f-4d69-b3e1-8e6619f3b9ed', '23833fbf-f640-4375-8e8e-da8f0a482148'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f4001641-7dba-4212-882b-02616d53dc97 tempest-CreateVolumesFromImageTest-958260192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f4001641-7dba-4212-882b-02616d53dc97 tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-f4001641-7dba-4212-882b-02616d53dc97 tempest-CreateVolumesFromImageTest-958260192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-f4001641-7dba-4212-882b-02616d53dc97 tempest-CreateVolumesFromImageTest-958260192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f4001641-7dba-4212-882b-02616d53dc97 tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f4001641-7dba-4212-882b-02616d53dc97 tempest-CreateVolumesFromImageTest-958260192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:56 devstack sudo[102001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:17:56 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:56 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-278e4dd2-e088-40b5-86d5-96cedfdc5c00 tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7.info" returned: 0 in 0.462s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-278e4dd2-e088-40b5-86d5-96cedfdc5c00 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.359s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.623s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Acquiring lock "cinder-quobyte-0acf9e49-c636-402b-9f67-50bd15ca406c-cc07a169-fdb0-4df6-9104-e209b9a7d92b" by "_create_volume_from_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:56 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-278e4dd2-e088-40b5-86d5-96cedfdc5c00 tempest-CreateVolumesFromSnapshotTest-287984160 None] Create snapshot completed successfully
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Lock "cinder-quobyte-0acf9e49-c636-402b-9f67-50bd15ca406c-cc07a169-fdb0-4df6-9104-e209b9a7d92b" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Creating volume cc07a169-fdb0-4df6-9104-e209b9a7d92b from snapshot 0acf9e49-c636-402b-9f67-50bd15ca406c {{(pid=80839) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Acquiring lock "cinder-quobyte-cc07a169-fdb0-4df6-9104-e209b9a7d92b" by "_copy_volume_from_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Lock "cinder-quobyte-cc07a169-fdb0-4df6-9104-e209b9a7d92b" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] snapshot: 0acf9e49-c636-402b-9f67-50bd15ca406c, volume: cc07a169-fdb0-4df6-9104-e209b9a7d92b,  {{(pid=80839) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:392}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b482c24-d0df-4051-9bef-e61d25484195]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:17:56 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.0acf9e49-c636-402b-9f67-50bd15ca406c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:56 devstack sudo[102004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.0acf9e49-c636-402b-9f67-50bd15ca406c
Nov 19 13:17:56 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:57 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f4001641-7dba-4212-882b-02616d53dc97 tempest-CreateVolumesFromImageTest-958260192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.478s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:57 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-f4001641-7dba-4212-882b-02616d53dc97 tempest-CreateVolumesFromImageTest-958260192 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:17:57 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-f4001641-7dba-4212-882b-02616d53dc97 tempest-CreateVolumesFromImageTest-958260192 None] Deleted volume successfully.
Nov 19 13:17:57 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f4001641-7dba-4212-882b-02616d53dc97 tempest-CreateVolumesFromImageTest-958260192 None] Lock "cinder-48296cfd-8763-49b4-9cda-1063c7a2cba0-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:57 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.0acf9e49-c636-402b-9f67-50bd15ca406c" returned: 0 in 0.582s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:57 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c34b63b-a460-4ff0-9942-5f5335adae7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:17:57 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f {{(pid=80839) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:411}}
Nov 19 13:17:57 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Creating direct copy from snapshot {{(pid=80839) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:419}}
Nov 19 13:17:57 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4706d4-60fa-4244-87d0-8ad1045495aa]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:17:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:57 devstack sudo[102010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f
Nov 19 13:17:57 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:57 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-881b115f-766a-46c4-b30e-981558669314 tempest-CreateVolumesFromImageTest-958260192 None] Acquiring lock "cinder-71014b0b-51c0-4251-adfe-6b7285a0c216-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:57 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-881b115f-766a-46c4-b30e-981558669314 tempest-CreateVolumesFromImageTest-958260192 None] Lock "cinder-71014b0b-51c0-4251-adfe-6b7285a0c216-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:57 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-881b115f-766a-46c4-b30e-981558669314 tempest-CreateVolumesFromImageTest-958260192 None] Acquiring lock "cinder-quobyte-71014b0b-51c0-4251-adfe-6b7285a0c216" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:17:57 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-881b115f-766a-46c4-b30e-981558669314 tempest-CreateVolumesFromImageTest-958260192 None] Lock "cinder-quobyte-71014b0b-51c0-4251-adfe-6b7285a0c216" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:17:57 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[489698c2-10a0-4f37-a76a-8e5922f003e6]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:17:57 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-881b115f-766a-46c4-b30e-981558669314 tempest-CreateVolumesFromImageTest-958260192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-71014b0b-51c0-4251-adfe-6b7285a0c216 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:57 devstack sudo[102012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-71014b0b-51c0-4251-adfe-6b7285a0c216
Nov 19 13:17:57 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Flow 'volume_create_manager' (fecc3417-8e0b-4ed5-a872-bfa33bb185fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acff7654-54e3-480c-8313-38a15eb188da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:58 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acff7654-54e3-480c-8313-38a15eb188da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2022788496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5314238-62f7-43ab-9120-42913c27a24f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ce7076a19247b1835699beb219b7fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:58Z,use_quota=True,user_id='dd78e4382e2840ea955ce0577ef40a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb0784bf-d7e8-41cd-aba5-2eb9a080a3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb0784bf-d7e8-41cd-aba5-2eb9a080a3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (796ff987-4b04-4c1f-9259-2bdf991925c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (796ff987-4b04-4c1f-9259-2bdf991925c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5314238-62f7-43ab-9120-42913c27a24f', 'volume_name': 'volume-d5314238-62f7-43ab-9120-42913c27a24f', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (400527ac-1df1-4b9c-a4a4-3b2a82747d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (400527ac-1df1-4b9c-a4a4-3b2a82747d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d79fe0a-5f1c-451b-b912-818f9c1bd82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:58 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Volume d5314238-62f7-43ab-9120-42913c27a24f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5314238-62f7-43ab-9120-42913c27a24f', 'volume_size': 1}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f" returned: 0 in 0.745s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.utils [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Path /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc07a169-fdb0-4df6-9104-e209b9a7d92b not found in is_blk_device check {{(pid=80839) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc07a169-fdb0-4df6-9104-e209b9a7d92b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:58 devstack sudo[102018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc07a169-fdb0-4df6-9104-e209b9a7d92b
Nov 19 13:17:58 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Flow 'volume_create_manager' (0fabdf12-c188-4694-a1b8-a26f3f1f1b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b6ac3b-ae87-407b-ac98-6422b627b150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b6ac3b-ae87-407b-ac98-6422b627b150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2017393459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7b172f0-6d52-412c-ae63-5efa27dec95f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ce7076a19247b1835699beb219b7fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:58Z,use_quota=True,user_id='dd78e4382e2840ea955ce0577ef40a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0fa617-3c3d-499a-8e17-985ffb41efac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0fa617-3c3d-499a-8e17-985ffb41efac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7063b80b-a86b-4e10-9943-6d283f4264a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7063b80b-a86b-4e10-9943-6d283f4264a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7b172f0-6d52-412c-ae63-5efa27dec95f', 'volume_name': 'volume-e7b172f0-6d52-412c-ae63-5efa27dec95f', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (465c4ffb-56b7-44dd-ab83-d2dad0750420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (465c4ffb-56b7-44dd-ab83-d2dad0750420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fbe09ab-d34d-439e-a920-1ad27d31b08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:58 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Volume e7b172f0-6d52-412c-ae63-5efa27dec95f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7b172f0-6d52-412c-ae63-5efa27dec95f', 'volume_size': 1}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:58 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-881b115f-766a-46c4-b30e-981558669314 tempest-CreateVolumesFromImageTest-958260192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-71014b0b-51c0-4251-adfe-6b7285a0c216" returned: 0 in 0.744s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-881b115f-766a-46c4-b30e-981558669314 tempest-CreateVolumesFromImageTest-958260192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-71014b0b-51c0-4251-adfe-6b7285a0c216 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:58 devstack sudo[102023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-71014b0b-51c0-4251-adfe-6b7285a0c216
Nov 19 13:17:58 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Flow 'volume_create_manager' (2fe23a2f-826b-483b-817a-73121156efa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bef950a-3c46-4451-ad22-c8ccbac36cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bef950a-3c46-4451-ad22-c8ccbac36cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1599614143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc505c5e-6740-4a34-b5f2-c5e94f0a239f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ce7076a19247b1835699beb219b7fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:58Z,use_quota=True,user_id='dd78e4382e2840ea955ce0577ef40a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5210bb49-26ca-46e3-be8c-292c6b37af99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5210bb49-26ca-46e3-be8c-292c6b37af99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d39c393-0689-4204-b620-036617b0bc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d39c393-0689-4204-b620-036617b0bc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc505c5e-6740-4a34-b5f2-c5e94f0a239f', 'volume_name': 'volume-fc505c5e-6740-4a34-b5f2-c5e94f0a239f', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2daf940-a548-4716-8229-ffea624ff3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2daf940-a548-4716-8229-ffea624ff3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb47f813-164f-4a68-9697-c95c5a1db174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:58 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Volume fc505c5e-6740-4a34-b5f2-c5e94f0a239f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc505c5e-6740-4a34-b5f2-c5e94f0a239f', 'volume_size': 1}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Flow 'volume_create_manager' (51be319f-dc67-40b2-afe8-29f63c9301a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339ce1e6-f0ac-447f-b00f-36cc7dfe8de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339ce1e6-f0ac-447f-b00f-36cc7dfe8de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-513898184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16071d53-5b7e-4053-8b7f-9fd6dc4ee25a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ce7076a19247b1835699beb219b7fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:59Z,use_quota=True,user_id='dd78e4382e2840ea955ce0577ef40a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2a32ef-03a8-4d6b-9af6-9786e6dc2374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2a32ef-03a8-4d6b-9af6-9786e6dc2374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26fccfd2-e7ed-4286-b775-1cce95ba91c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26fccfd2-e7ed-4286-b775-1cce95ba91c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16071d53-5b7e-4053-8b7f-9fd6dc4ee25a', 'volume_name': 'volume-16071d53-5b7e-4053-8b7f-9fd6dc4ee25a', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (286e1cac-7917-45e3-813f-e93971549565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (286e1cac-7917-45e3-813f-e93971549565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbb3f513-a40c-4840-88fa-df6c799158a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:58 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Volume 16071d53-5b7e-4053-8b7f-9fd6dc4ee25a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16071d53-5b7e-4053-8b7f-9fd6dc4ee25a', 'volume_size': 1}
Nov 19 13:17:58 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:59 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root
Nov 19 13:17:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-881b115f-766a-46c4-b30e-981558669314 tempest-CreateVolumesFromImageTest-958260192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-71014b0b-51c0-4251-adfe-6b7285a0c216" returned: 0 in 0.929s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:17:59 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-881b115f-766a-46c4-b30e-981558669314 tempest-CreateVolumesFromImageTest-958260192 None] Lock "cinder-quobyte-71014b0b-51c0-4251-adfe-6b7285a0c216" released by "delete_volume" :: held 1.725s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:17:59 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:17:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Flow 'volume_create_manager' (b84be7d2-8505-4df9-95f7-a99dd7c27f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:17:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280e7041-76b8-496b-8039-f2a7ce7bd4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:59 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-881b115f-766a-46c4-b30e-981558669314 tempest-CreateVolumesFromImageTest-958260192 None] Created reservations ['43b4c810-b56e-4692-8185-140f734bb64d', 'c85b5541-48a4-4047-aa36-87f0498a4e2c', '3a18a694-1aec-4b9a-b961-b7226216f6ad', 'f42e6002-29d5-41b2-b40c-8004d0153fba'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:17:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280e7041-76b8-496b-8039-f2a7ce7bd4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-777181814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa438c09-882f-4b56-8d1b-a1cbfb3fe648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ce7076a19247b1835699beb219b7fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:59Z,use_quota=True,user_id='dd78e4382e2840ea955ce0577ef40a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0696e5d2-23f2-439a-8fc0-526746a28e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0696e5d2-23f2-439a-8fc0-526746a28e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (923069c9-419f-4558-9740-1269adbf8a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (923069c9-419f-4558-9740-1269adbf8a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa438c09-882f-4b56-8d1b-a1cbfb3fe648', 'volume_name': 'volume-aa438c09-882f-4b56-8d1b-a1cbfb3fe648', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee7f347-42f0-4072-9c6f-e2b43acc5eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee7f347-42f0-4072-9c6f-e2b43acc5eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:17:59 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e423269-e294-484b-aec9-4a43f7725342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:17:59 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Volume aa438c09-882f-4b56-8d1b-a1cbfb3fe648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa438c09-882f-4b56-8d1b-a1cbfb3fe648', 'volume_size': 1}
Nov 19 13:17:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-881b115f-766a-46c4-b30e-981558669314 tempest-CreateVolumesFromImageTest-958260192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:17:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-881b115f-766a-46c4-b30e-981558669314 tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:17:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-881b115f-766a-46c4-b30e-981558669314 tempest-CreateVolumesFromImageTest-958260192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:17:59 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-881b115f-766a-46c4-b30e-981558669314 tempest-CreateVolumesFromImageTest-958260192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:17:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-881b115f-766a-46c4-b30e-981558669314 tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:17:59 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-881b115f-766a-46c4-b30e-981558669314 tempest-CreateVolumesFromImageTest-958260192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:17:59 devstack sudo[102037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:17:59 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:00 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-196673d1-b985-4d10-858f-d263240e9168 tempest-CreateVolumesFromImageTest-958260192 None] Acquiring lock "cinder-ee85fd57-a4b0-497a-8992-0ff3bc9db81f-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:00 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-196673d1-b985-4d10-858f-d263240e9168 tempest-CreateVolumesFromImageTest-958260192 None] Lock "cinder-ee85fd57-a4b0-497a-8992-0ff3bc9db81f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:00 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-196673d1-b985-4d10-858f-d263240e9168 tempest-CreateVolumesFromImageTest-958260192 None] Acquiring lock "cinder-quobyte-ee85fd57-a4b0-497a-8992-0ff3bc9db81f" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:00 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-196673d1-b985-4d10-858f-d263240e9168 tempest-CreateVolumesFromImageTest-958260192 None] Lock "cinder-quobyte-ee85fd57-a4b0-497a-8992-0ff3bc9db81f" acquired by "delete_volume" :: waited 0.027s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:00 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c11f065-d59f-4712-b4fb-b204c6bef0b0]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-196673d1-b985-4d10-858f-d263240e9168 tempest-CreateVolumesFromImageTest-958260192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee85fd57-a4b0-497a-8992-0ff3bc9db81f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:00 devstack sudo[102039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee85fd57-a4b0-497a-8992-0ff3bc9db81f
Nov 19 13:18:00 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:00 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc07a169-fdb0-4df6-9104-e209b9a7d92b" returned: 0 in 2.467s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:00 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[68565201-38fa-43cd-95c0-4a220bf971ba]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:00 devstack sudo[102041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f
Nov 19 13:18:00 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:00 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:00 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-881b115f-766a-46c4-b30e-981558669314 tempest-CreateVolumesFromImageTest-958260192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.923s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:00 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-881b115f-766a-46c4-b30e-981558669314 tempest-CreateVolumesFromImageTest-958260192 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:18:00 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-881b115f-766a-46c4-b30e-981558669314 tempest-CreateVolumesFromImageTest-958260192 None] Deleted volume successfully.
Nov 19 13:18:00 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-881b115f-766a-46c4-b30e-981558669314 tempest-CreateVolumesFromImageTest-958260192 None] Lock "cinder-71014b0b-51c0-4251-adfe-6b7285a0c216-delete_volume" released by "delete_volume" :: held 3.176s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:01 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-196673d1-b985-4d10-858f-d263240e9168 tempest-CreateVolumesFromImageTest-958260192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee85fd57-a4b0-497a-8992-0ff3bc9db81f" returned: 0 in 0.757s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-196673d1-b985-4d10-858f-d263240e9168 tempest-CreateVolumesFromImageTest-958260192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee85fd57-a4b0-497a-8992-0ff3bc9db81f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:01 devstack sudo[102047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee85fd57-a4b0-497a-8992-0ff3bc9db81f
Nov 19 13:18:01 devstack sudo[102047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:01 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f" returned: 0 in 0.678s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Image conversion details: src /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f, size 1024.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc07a169-fdb0-4df6-9104-e209b9a7d92b {{(pid=80839) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 19 13:18:01 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Converted 1024.00 MB image at 414.84 MB/s
Nov 19 13:18:01 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc07a169-fdb0-4df6-9104-e209b9a7d92b is being set with open permissions: ugo+rw
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc07a169-fdb0-4df6-9104-e209b9a7d92b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:01 devstack sudo[102052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc07a169-fdb0-4df6-9104-e209b9a7d92b
Nov 19 13:18:01 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:01 devstack sudo[102047]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-196673d1-b985-4d10-858f-d263240e9168 tempest-CreateVolumesFromImageTest-958260192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ee85fd57-a4b0-497a-8992-0ff3bc9db81f" returned: 0 in 0.442s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-196673d1-b985-4d10-858f-d263240e9168 tempest-CreateVolumesFromImageTest-958260192 None] Lock "cinder-quobyte-ee85fd57-a4b0-497a-8992-0ff3bc9db81f" released by "delete_volume" :: held 1.250s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-196673d1-b985-4d10-858f-d263240e9168 tempest-CreateVolumesFromImageTest-958260192 None] Created reservations ['4b7c01d6-c96c-4f51-90d9-c0d753d67a44', '76315fe7-e7c5-4e58-b34e-509b4aea3a82', '3bdb8f61-536c-48c6-91b4-65135c0f50ee', 'b239400a-b05e-4569-a49f-60b1d0a8d202'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-196673d1-b985-4d10-858f-d263240e9168 tempest-CreateVolumesFromImageTest-958260192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-196673d1-b985-4d10-858f-d263240e9168 tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-196673d1-b985-4d10-858f-d263240e9168 tempest-CreateVolumesFromImageTest-958260192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-196673d1-b985-4d10-858f-d263240e9168 tempest-CreateVolumesFromImageTest-958260192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-196673d1-b985-4d10-858f-d263240e9168 tempest-CreateVolumesFromImageTest-958260192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-196673d1-b985-4d10-858f-d263240e9168 tempest-CreateVolumesFromImageTest-958260192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:01 devstack sudo[102055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:18:01 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:01 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc07a169-fdb0-4df6-9104-e209b9a7d92b" returned: 0 in 0.497s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Lock "cinder-quobyte-cc07a169-fdb0-4df6-9104-e209b9a7d92b" released by "_copy_volume_from_snapshot" :: held 5.034s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Lock "cinder-quobyte-0acf9e49-c636-402b-9f67-50bd15ca406c-cc07a169-fdb0-4df6-9104-e209b9a7d92b" released by "_create_volume_from_snapshot" :: held 5.053s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.071s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.377s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-453789027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1ec2305-6bae-42a7-9220-5547071969cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e81e4ca6024ff2b2ce87d0811adb36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:54Z,use_quota=True,user_id='ca34ddd87c9a4c2eac433a3c13b9952b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Creating volume a1ec2305-6bae-42a7-9220-5547071969cc {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:18:01 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef91709-2248-4eeb-bff1-f46bcb046663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc07a169-fdb0-4df6-9104-e209b9a7d92b', 'volume_size': 1, 'snapshot_id': '0acf9e49-c636-402b-9f67-50bd15ca406c'}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50bea8e-4456-4059-8e4e-e6a451dca7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:01 devstack sudo[102058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc 1073741824
Nov 19 13:18:01 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:01 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Volume volume-cc07a169-fdb0-4df6-9104-e209b9a7d92b (cc07a169-fdb0-4df6-9104-e209b9a7d92b): created successfully
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50bea8e-4456-4059-8e4e-e6a451dca7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:01 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Flow 'volume_create_manager' (62583e71-2f54-4e61-926c-9dae58d80cd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:18:01 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-abba69c8-1de9-447c-a438-ec01473f3782 tempest-VolumeDependencyTests-1207279966 None] Created volume successfully.
Nov 19 13:18:02 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-196673d1-b985-4d10-858f-d263240e9168 tempest-CreateVolumesFromImageTest-958260192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.478s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-196673d1-b985-4d10-858f-d263240e9168 tempest-CreateVolumesFromImageTest-958260192 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:18:02 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-196673d1-b985-4d10-858f-d263240e9168 tempest-CreateVolumesFromImageTest-958260192 None] Deleted volume successfully.
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-196673d1-b985-4d10-858f-d263240e9168 tempest-CreateVolumesFromImageTest-958260192 None] Lock "cinder-ee85fd57-a4b0-497a-8992-0ff3bc9db81f-delete_volume" released by "delete_volume" :: held 1.994s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:02 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc 1073741824" returned: 0 in 0.596s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:02 devstack sudo[102064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc
Nov 19 13:18:02 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d9cde25c-01f5-4151-83e9-15d882469bb0 tempest-VolumeDependencyTests-1207279966 None] Acquiring lock "cinder-0acf9e49-c636-402b-9f67-50bd15ca406c-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d9cde25c-01f5-4151-83e9-15d882469bb0 tempest-VolumeDependencyTests-1207279966 None] Lock "cinder-0acf9e49-c636-402b-9f67-50bd15ca406c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d9cde25c-01f5-4151-83e9-15d882469bb0 tempest-VolumeDependencyTests-1207279966 None] Acquiring lock "cinder-quobyte-5c34b63b-a460-4ff0-9942-5f5335adae7f" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d9cde25c-01f5-4151-83e9-15d882469bb0 tempest-VolumeDependencyTests-1207279966 None] Lock "cinder-quobyte-5c34b63b-a460-4ff0-9942-5f5335adae7f" acquired by "delete_snapshot" :: waited 0.012s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d9cde25c-01f5-4151-83e9-15d882469bb0 tempest-VolumeDependencyTests-1207279966 None] Acquiring lock "cinder-quobyte-0acf9e49-c636-402b-9f67-50bd15ca406c" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d9cde25c-01f5-4151-83e9-15d882469bb0 tempest-VolumeDependencyTests-1207279966 None] Lock "cinder-quobyte-0acf9e49-c636-402b-9f67-50bd15ca406c" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-d9cde25c-01f5-4151-83e9-15d882469bb0 tempest-VolumeDependencyTests-1207279966 None] Deleting offline snapshot 0acf9e49-c636-402b-9f67-50bd15ca406c of volume 5c34b63b-a460-4ff0-9942-5f5335adae7f {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-d9cde25c-01f5-4151-83e9-15d882469bb0 tempest-VolumeDependencyTests-1207279966 None] snapshot_file for this snap is: volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.0acf9e49-c636-402b-9f67-50bd15ca406c {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1558f9a2-4c90-441d-8693-da5a485752a4]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d9cde25c-01f5-4151-83e9-15d882469bb0 tempest-VolumeDependencyTests-1207279966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.0acf9e49-c636-402b-9f67-50bd15ca406c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:02 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc" returned: 0 in 0.508s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.791s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2022788496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5314238-62f7-43ab-9120-42913c27a24f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ce7076a19247b1835699beb219b7fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:58Z,use_quota=True,user_id='dd78e4382e2840ea955ce0577ef40a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Creating volume d5314238-62f7-43ab-9120-42913c27a24f {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:18:02 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5314238-62f7-43ab-9120-42913c27a24f 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f237f71-824a-44c5-843d-daeb6fff8bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1ec2305-6bae-42a7-9220-5547071969cc', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f36e81-2ed3-4f42-8872-7fd2b8c4cdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:02 devstack sudo[102069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5314238-62f7-43ab-9120-42913c27a24f 1073741824
Nov 19 13:18:02 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Volume volume-a1ec2305-6bae-42a7-9220-5547071969cc (a1ec2305-6bae-42a7-9220-5547071969cc): created successfully
Nov 19 13:18:02 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f36e81-2ed3-4f42-8872-7fd2b8c4cdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:02 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Flow 'volume_create_manager' (9cbf6cd1-47d5-497d-b872-ffdc5420e326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:18:02 devstack sudo[102067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.0acf9e49-c636-402b-9f67-50bd15ca406c
Nov 19 13:18:02 devstack sudo[102067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:02 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-7f6df35d-d842-4b4c-9176-1a73768ab8f7 tempest-SnapshotDependencyTests-73392086 None] Created volume successfully.
Nov 19 13:18:03 devstack sudo[102067]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d9cde25c-01f5-4151-83e9-15d882469bb0 tempest-VolumeDependencyTests-1207279966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.0acf9e49-c636-402b-9f67-50bd15ca406c" returned: 0 in 0.664s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:03 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-d9cde25c-01f5-4151-83e9-15d882469bb0 tempest-VolumeDependencyTests-1207279966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c34b63b-a460-4ff0-9942-5f5335adae7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:18:03 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81973cf-691b-41d3-8d11-b2927de697ad]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d9cde25c-01f5-4151-83e9-15d882469bb0 tempest-VolumeDependencyTests-1207279966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:03 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5314238-62f7-43ab-9120-42913c27a24f 1073741824" returned: 0 in 0.619s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:03 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5314238-62f7-43ab-9120-42913c27a24f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:03 devstack sudo[102079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5314238-62f7-43ab-9120-42913c27a24f
Nov 19 13:18:03 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:03 devstack sudo[102078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f
Nov 19 13:18:03 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Flow 'volume_create_manager' (b853f8f3-1385-485b-b61e-00703ec285dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced8a05e-e480-41df-8e80-5f388e53e8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:04 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced8a05e-e480-41df-8e80-5f388e53e8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1678102800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0562aaca-1381-470d-8b29-a7262291ae49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2816e7c6a57e4c2f93f7ef435b46cf17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:18:04Z,use_quota=True,user_id='6c7d85ddf16544f2a9e4df676ec39916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bddfb30d-2a82-4240-9275-6664000c2cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bddfb30d-2a82-4240-9275-6664000c2cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2b9130e-7da5-4240-a800-ae23b7e22fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2b9130e-7da5-4240-a800-ae23b7e22fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0562aaca-1381-470d-8b29-a7262291ae49', 'volume_name': 'volume-0562aaca-1381-470d-8b29-a7262291ae49', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7ef630-b0a8-46d3-ab47-0388e4e33dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7ef630-b0a8-46d3-ab47-0388e4e33dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (851a2541-b0ae-4e47-a026-ea335901a802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:04 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Volume 0562aaca-1381-470d-8b29-a7262291ae49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0562aaca-1381-470d-8b29-a7262291ae49', 'volume_size': 1}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5314238-62f7-43ab-9120-42913c27a24f" returned: 0 in 0.542s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.789s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2017393459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7b172f0-6d52-412c-ae63-5efa27dec95f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ce7076a19247b1835699beb219b7fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:58Z,use_quota=True,user_id='dd78e4382e2840ea955ce0577ef40a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Creating volume e7b172f0-6d52-412c-ae63-5efa27dec95f {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:18:04 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e7b172f0-6d52-412c-ae63-5efa27dec95f 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d79fe0a-5f1c-451b-b912-818f9c1bd82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5314238-62f7-43ab-9120-42913c27a24f', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05349427-ff8e-4121-b1c6-6f0ffd7a3fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:04 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Volume volume-d5314238-62f7-43ab-9120-42913c27a24f (d5314238-62f7-43ab-9120-42913c27a24f): created successfully
Nov 19 13:18:04 devstack sudo[102083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e7b172f0-6d52-412c-ae63-5efa27dec95f 1073741824
Nov 19 13:18:04 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05349427-ff8e-4121-b1c6-6f0ffd7a3fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Flow 'volume_create_manager' (fecc3417-8e0b-4ed5-a872-bfa33bb185fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:18:04 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-08b38633-4c9e-4830-bbe1-40b6a374580c tempest-CreateVolumesFromSnapshotTest-287984160 None] Created volume successfully.
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b2a84f04-498d-424e-b56f-45676553e28a tempest-SnapshotDependencyTests-73392086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:04 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d9cde25c-01f5-4151-83e9-15d882469bb0 tempest-VolumeDependencyTests-1207279966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f" returned: 0 in 0.722s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d9cde25c-01f5-4151-83e9-15d882469bb0 tempest-VolumeDependencyTests-1207279966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.0acf9e49-c636-402b-9f67-50bd15ca406c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:04 devstack sudo[102088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.0acf9e49-c636-402b-9f67-50bd15ca406c
Nov 19 13:18:04 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG oslo_service.periodic_task [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=80839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:04 devstack sudo[102093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:18:04 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:04 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e7b172f0-6d52-412c-ae63-5efa27dec95f 1073741824" returned: 0 in 0.631s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e7b172f0-6d52-412c-ae63-5efa27dec95f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:04 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d9cde25c-01f5-4151-83e9-15d882469bb0 tempest-VolumeDependencyTests-1207279966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.0acf9e49-c636-402b-9f67-50bd15ca406c" returned: 0 in 0.495s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:04 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d9cde25c-01f5-4151-83e9-15d882469bb0 tempest-VolumeDependencyTests-1207279966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.0acf9e49-c636-402b-9f67-50bd15ca406c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:04 devstack sudo[102098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e7b172f0-6d52-412c-ae63-5efa27dec95f
Nov 19 13:18:04 devstack sudo[102098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:04 devstack sudo[102100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.0acf9e49-c636-402b-9f67-50bd15ca406c
Nov 19 13:18:04 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:05 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.556s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-277e46a3-ac81-411d-be62-c8d54078039f None None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:18:05 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d9cde25c-01f5-4151-83e9-15d882469bb0 tempest-VolumeDependencyTests-1207279966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f.0acf9e49-c636-402b-9f67-50bd15ca406c" returned: 0 in 0.441s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:05 devstack sudo[102098]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e7b172f0-6d52-412c-ae63-5efa27dec95f" returned: 0 in 0.474s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d9cde25c-01f5-4151-83e9-15d882469bb0 tempest-VolumeDependencyTests-1207279966 None] Lock "cinder-quobyte-0acf9e49-c636-402b-9f67-50bd15ca406c" released by "_delete_snapshot" :: held 2.403s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.686s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1599614143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc505c5e-6740-4a34-b5f2-c5e94f0a239f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ce7076a19247b1835699beb219b7fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:58Z,use_quota=True,user_id='dd78e4382e2840ea955ce0577ef40a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Creating volume fc505c5e-6740-4a34-b5f2-c5e94f0a239f {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:18:05 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fc505c5e-6740-4a34-b5f2-c5e94f0a239f 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d9cde25c-01f5-4151-83e9-15d882469bb0 tempest-VolumeDependencyTests-1207279966 None] Lock "cinder-quobyte-5c34b63b-a460-4ff0-9942-5f5335adae7f" released by "delete_snapshot" :: held 2.437s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:05 devstack sudo[102105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fc505c5e-6740-4a34-b5f2-c5e94f0a239f 1073741824
Nov 19 13:18:05 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fbe09ab-d34d-439e-a920-1ad27d31b08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7b172f0-6d52-412c-ae63-5efa27dec95f', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f487a7bc-24f5-4cdb-9253-c447c0f25fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:05 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Volume volume-e7b172f0-6d52-412c-ae63-5efa27dec95f (e7b172f0-6d52-412c-ae63-5efa27dec95f): created successfully
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f487a7bc-24f5-4cdb-9253-c447c0f25fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Flow 'volume_create_manager' (0fabdf12-c188-4694-a1b8-a26f3f1f1b66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:18:05 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-88be022a-3ddc-4936-8a99-bedd4cf11b39 tempest-CreateVolumesFromSnapshotTest-287984160 None] Created volume successfully.
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-d9cde25c-01f5-4151-83e9-15d882469bb0 tempest-VolumeDependencyTests-1207279966 None] Created reservations ['f2376611-5ecd-4875-b27a-847d742c7eb8', 'f1a56a20-2a1e-4b1d-8bc8-e1e259615f3a', '9e6ad221-f2cf-4ddd-ba61-560dea06d3d3', 'aebdcbfc-c11d-4944-b786-3f6cd4c5a593'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:18:05 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-d9cde25c-01f5-4151-83e9-15d882469bb0 tempest-VolumeDependencyTests-1207279966 None] Delete snapshot completed successfully.
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d9cde25c-01f5-4151-83e9-15d882469bb0 tempest-VolumeDependencyTests-1207279966 None] Lock "cinder-0acf9e49-c636-402b-9f67-50bd15ca406c-delete_snapshot" released by "delete_snapshot" :: held 2.546s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:05 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fc505c5e-6740-4a34-b5f2-c5e94f0a239f 1073741824" returned: 0 in 0.523s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fc505c5e-6740-4a34-b5f2-c5e94f0a239f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:05 devstack sudo[102110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fc505c5e-6740-4a34-b5f2-c5e94f0a239f
Nov 19 13:18:05 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-db642349-5394-447b-80c1-7a7219ae4d17 tempest-VolumeDependencyTests-1207279966 None] Acquiring lock "cinder-5c34b63b-a460-4ff0-9942-5f5335adae7f-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-db642349-5394-447b-80c1-7a7219ae4d17 tempest-VolumeDependencyTests-1207279966 None] Lock "cinder-5c34b63b-a460-4ff0-9942-5f5335adae7f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-db642349-5394-447b-80c1-7a7219ae4d17 tempest-VolumeDependencyTests-1207279966 None] Acquiring lock "cinder-quobyte-5c34b63b-a460-4ff0-9942-5f5335adae7f" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-db642349-5394-447b-80c1-7a7219ae4d17 tempest-VolumeDependencyTests-1207279966 None] Lock "cinder-quobyte-5c34b63b-a460-4ff0-9942-5f5335adae7f" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6657b1c-9d81-4811-ac00-aa64c32572e3]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:05 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-db642349-5394-447b-80c1-7a7219ae4d17 tempest-VolumeDependencyTests-1207279966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:06 devstack sudo[102112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f
Nov 19 13:18:06 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:06 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fc505c5e-6740-4a34-b5f2-c5e94f0a239f" returned: 0 in 0.508s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:18:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.262s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-513898184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16071d53-5b7e-4053-8b7f-9fd6dc4ee25a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ce7076a19247b1835699beb219b7fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:59Z,use_quota=True,user_id='dd78e4382e2840ea955ce0577ef40a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:18:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Creating volume 16071d53-5b7e-4053-8b7f-9fd6dc4ee25a {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:18:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:06 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:18:06 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:18:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-16071d53-5b7e-4053-8b7f-9fd6dc4ee25a 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb47f813-164f-4a68-9697-c95c5a1db174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc505c5e-6740-4a34-b5f2-c5e94f0a239f', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d465e9c-4a98-4207-8a73-a8bd9679a6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:06 devstack sudo[102115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-16071d53-5b7e-4053-8b7f-9fd6dc4ee25a 1073741824
Nov 19 13:18:06 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:06 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Volume volume-fc505c5e-6740-4a34-b5f2-c5e94f0a239f (fc505c5e-6740-4a34-b5f2-c5e94f0a239f): created successfully
Nov 19 13:18:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d465e9c-4a98-4207-8a73-a8bd9679a6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:06 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Flow 'volume_create_manager' (2fe23a2f-826b-483b-817a-73121156efa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:18:06 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-1db4f2f2-58ce-42c5-9dc3-bbdbd15b2b6d tempest-CreateVolumesFromSnapshotTest-287984160 None] Created volume successfully.
Nov 19 13:18:06 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-db642349-5394-447b-80c1-7a7219ae4d17 tempest-VolumeDependencyTests-1207279966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f" returned: 0 in 0.592s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-db642349-5394-447b-80c1-7a7219ae4d17 tempest-VolumeDependencyTests-1207279966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:06 devstack sudo[102120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f
Nov 19 13:18:06 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:06 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-16071d53-5b7e-4053-8b7f-9fd6dc4ee25a 1073741824" returned: 0 in 0.563s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:06 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-16071d53-5b7e-4053-8b7f-9fd6dc4ee25a {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:06 devstack sudo[102125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-16071d53-5b7e-4053-8b7f-9fd6dc4ee25a
Nov 19 13:18:06 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:07 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-db642349-5394-447b-80c1-7a7219ae4d17 tempest-VolumeDependencyTests-1207279966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5c34b63b-a460-4ff0-9942-5f5335adae7f" returned: 0 in 0.467s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-db642349-5394-447b-80c1-7a7219ae4d17 tempest-VolumeDependencyTests-1207279966 None] Lock "cinder-quobyte-5c34b63b-a460-4ff0-9942-5f5335adae7f" released by "delete_volume" :: held 1.093s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-db642349-5394-447b-80c1-7a7219ae4d17 tempest-VolumeDependencyTests-1207279966 None] Created reservations ['6d31c091-0b47-444c-8db0-47359d242481', 'dcc1941a-e78d-45b4-8ef8-d72bded3e2e9', '6c2d412f-ba35-4cdd-a657-104df4975fbd', '56cf7eb1-bf14-4d25-b3ac-29b1bf821cf9'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-db642349-5394-447b-80c1-7a7219ae4d17 tempest-VolumeDependencyTests-1207279966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-db642349-5394-447b-80c1-7a7219ae4d17 tempest-VolumeDependencyTests-1207279966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-db642349-5394-447b-80c1-7a7219ae4d17 tempest-VolumeDependencyTests-1207279966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-db642349-5394-447b-80c1-7a7219ae4d17 tempest-VolumeDependencyTests-1207279966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-db642349-5394-447b-80c1-7a7219ae4d17 tempest-VolumeDependencyTests-1207279966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-db642349-5394-447b-80c1-7a7219ae4d17 tempest-VolumeDependencyTests-1207279966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:07 devstack sudo[102128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:18:07 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:07 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-16071d53-5b7e-4053-8b7f-9fd6dc4ee25a" returned: 0 in 0.465s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.546s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-777181814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa438c09-882f-4b56-8d1b-a1cbfb3fe648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ce7076a19247b1835699beb219b7fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:17:59Z,use_quota=True,user_id='dd78e4382e2840ea955ce0577ef40a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Creating volume aa438c09-882f-4b56-8d1b-a1cbfb3fe648 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:18:07 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-aa438c09-882f-4b56-8d1b-a1cbfb3fe648 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbb3f513-a40c-4840-88fa-df6c799158a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16071d53-5b7e-4053-8b7f-9fd6dc4ee25a', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d749afe-8f0a-4dde-b26c-770f4438a079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:07 devstack sudo[102131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-aa438c09-882f-4b56-8d1b-a1cbfb3fe648 1073741824
Nov 19 13:18:07 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:07 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Volume volume-16071d53-5b7e-4053-8b7f-9fd6dc4ee25a (16071d53-5b7e-4053-8b7f-9fd6dc4ee25a): created successfully
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d749afe-8f0a-4dde-b26c-770f4438a079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Flow 'volume_create_manager' (51be319f-dc67-40b2-afe8-29f63c9301a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:18:07 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-9f8a075d-7660-4ad9-8819-14b31d3863fc tempest-CreateVolumesFromSnapshotTest-287984160 None] Created volume successfully.
Nov 19 13:18:07 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-db642349-5394-447b-80c1-7a7219ae4d17 tempest-VolumeDependencyTests-1207279966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.484s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-db642349-5394-447b-80c1-7a7219ae4d17 tempest-VolumeDependencyTests-1207279966 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:18:07 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-db642349-5394-447b-80c1-7a7219ae4d17 tempest-VolumeDependencyTests-1207279966 None] Deleted volume successfully.
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-db642349-5394-447b-80c1-7a7219ae4d17 tempest-VolumeDependencyTests-1207279966 None] Lock "cinder-5c34b63b-a460-4ff0-9942-5f5335adae7f-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:07 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-aa438c09-882f-4b56-8d1b-a1cbfb3fe648 1073741824" returned: 0 in 0.530s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:07 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-aa438c09-882f-4b56-8d1b-a1cbfb3fe648 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:07 devstack sudo[102137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-aa438c09-882f-4b56-8d1b-a1cbfb3fe648
Nov 19 13:18:07 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:08 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-878a0af2-508c-4af9-8215-90badf7a15c0 tempest-VolumeDependencyTests-1207279966 None] Acquiring lock "cinder-cc07a169-fdb0-4df6-9104-e209b9a7d92b-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:08 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-878a0af2-508c-4af9-8215-90badf7a15c0 tempest-VolumeDependencyTests-1207279966 None] Lock "cinder-cc07a169-fdb0-4df6-9104-e209b9a7d92b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:08 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-878a0af2-508c-4af9-8215-90badf7a15c0 tempest-VolumeDependencyTests-1207279966 None] Acquiring lock "cinder-quobyte-cc07a169-fdb0-4df6-9104-e209b9a7d92b" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:08 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-878a0af2-508c-4af9-8215-90badf7a15c0 tempest-VolumeDependencyTests-1207279966 None] Lock "cinder-quobyte-cc07a169-fdb0-4df6-9104-e209b9a7d92b" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:08 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e381d08d-03d2-4a6e-a286-03b6940517a9]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-878a0af2-508c-4af9-8215-90badf7a15c0 tempest-VolumeDependencyTests-1207279966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc07a169-fdb0-4df6-9104-e209b9a7d92b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:08 devstack sudo[102139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc07a169-fdb0-4df6-9104-e209b9a7d92b
Nov 19 13:18:08 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:08 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-aa438c09-882f-4b56-8d1b-a1cbfb3fe648" returned: 0 in 0.510s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:08 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:18:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.275s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:08 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1678102800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0562aaca-1381-470d-8b29-a7262291ae49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2816e7c6a57e4c2f93f7ef435b46cf17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:18:04Z,use_quota=True,user_id='6c7d85ddf16544f2a9e4df676ec39916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:18:08 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Creating volume 0562aaca-1381-470d-8b29-a7262291ae49 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:18:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:08 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:08 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:08 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:18:08 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:18:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0562aaca-1381-470d-8b29-a7262291ae49 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:08 devstack sudo[102142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0562aaca-1381-470d-8b29-a7262291ae49 1073741824
Nov 19 13:18:08 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:08 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e423269-e294-484b-aec9-4a43f7725342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa438c09-882f-4b56-8d1b-a1cbfb3fe648', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:08 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da06a49f-61a2-4717-8f2b-9e50090167bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:08 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Volume volume-aa438c09-882f-4b56-8d1b-a1cbfb3fe648 (aa438c09-882f-4b56-8d1b-a1cbfb3fe648): created successfully
Nov 19 13:18:08 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da06a49f-61a2-4717-8f2b-9e50090167bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:08 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Flow 'volume_create_manager' (b84be7d2-8505-4df9-95f7-a99dd7c27f62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:18:08 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-a50c0ce2-ece7-417c-b2f8-73c3d72923ba tempest-CreateVolumesFromSnapshotTest-287984160 None] Created volume successfully.
Nov 19 13:18:08 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-878a0af2-508c-4af9-8215-90badf7a15c0 tempest-VolumeDependencyTests-1207279966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc07a169-fdb0-4df6-9104-e209b9a7d92b" returned: 0 in 0.615s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-878a0af2-508c-4af9-8215-90badf7a15c0 tempest-VolumeDependencyTests-1207279966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc07a169-fdb0-4df6-9104-e209b9a7d92b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:08 devstack sudo[102150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc07a169-fdb0-4df6-9104-e209b9a7d92b
Nov 19 13:18:08 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:08 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0562aaca-1381-470d-8b29-a7262291ae49 1073741824" returned: 0 in 0.559s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:08 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0562aaca-1381-470d-8b29-a7262291ae49 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:08 devstack sudo[102152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0562aaca-1381-470d-8b29-a7262291ae49
Nov 19 13:18:08 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-069ddd8a-4dc0-4143-8882-2ba9de0d04ad tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "cinder-aa438c09-882f-4b56-8d1b-a1cbfb3fe648-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-069ddd8a-4dc0-4143-8882-2ba9de0d04ad tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-aa438c09-882f-4b56-8d1b-a1cbfb3fe648-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-069ddd8a-4dc0-4143-8882-2ba9de0d04ad tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "cinder-quobyte-aa438c09-882f-4b56-8d1b-a1cbfb3fe648" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-069ddd8a-4dc0-4143-8882-2ba9de0d04ad tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-quobyte-aa438c09-882f-4b56-8d1b-a1cbfb3fe648" acquired by "delete_volume" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d315848-0bb7-4405-ac47-4b119c10af8a]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-069ddd8a-4dc0-4143-8882-2ba9de0d04ad tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-aa438c09-882f-4b56-8d1b-a1cbfb3fe648 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:09 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-878a0af2-508c-4af9-8215-90badf7a15c0 tempest-VolumeDependencyTests-1207279966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-cc07a169-fdb0-4df6-9104-e209b9a7d92b" returned: 0 in 0.535s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-878a0af2-508c-4af9-8215-90badf7a15c0 tempest-VolumeDependencyTests-1207279966 None] Lock "cinder-quobyte-cc07a169-fdb0-4df6-9104-e209b9a7d92b" released by "delete_volume" :: held 1.181s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-878a0af2-508c-4af9-8215-90badf7a15c0 tempest-VolumeDependencyTests-1207279966 None] Created reservations ['02b16052-1a8c-46d9-9f60-74be48233074', 'acbd547b-87c8-485f-a569-68d81d3d4a7a', 'b7993119-8fc5-4449-b2b5-7ff9cacbaf64', '23dc773e-f290-4ad3-8a63-138abd01e8b0'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-878a0af2-508c-4af9-8215-90badf7a15c0 tempest-VolumeDependencyTests-1207279966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-878a0af2-508c-4af9-8215-90badf7a15c0 tempest-VolumeDependencyTests-1207279966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-878a0af2-508c-4af9-8215-90badf7a15c0 tempest-VolumeDependencyTests-1207279966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-878a0af2-508c-4af9-8215-90badf7a15c0 tempest-VolumeDependencyTests-1207279966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-878a0af2-508c-4af9-8215-90badf7a15c0 tempest-VolumeDependencyTests-1207279966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-878a0af2-508c-4af9-8215-90badf7a15c0 tempest-VolumeDependencyTests-1207279966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:09 devstack sudo[102155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-aa438c09-882f-4b56-8d1b-a1cbfb3fe648
Nov 19 13:18:09 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:09 devstack sudo[102157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:18:09 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:09 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0562aaca-1381-470d-8b29-a7262291ae49" returned: 0 in 0.548s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b2a84f04-498d-424e-b56f-45676553e28a tempest-SnapshotDependencyTests-73392086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.320s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-b2a84f04-498d-424e-b56f-45676553e28a tempest-SnapshotDependencyTests-73392086 None] Creating offline snapshot 1218bea4-e814-42c4-90ea-4932dac27c3e of volume a1ec2305-6bae-42a7-9220-5547071969cc {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (851a2541-b0ae-4e47-a026-ea335901a802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0562aaca-1381-470d-8b29-a7262291ae49', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e38a92-2896-4e69-9de2-d061765f2081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[28474eba-25d2-42aa-a777-11e55a35a867]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b2a84f04-498d-424e-b56f-45676553e28a tempest-SnapshotDependencyTests-73392086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:09 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Volume volume-0562aaca-1381-470d-8b29-a7262291ae49 (0562aaca-1381-470d-8b29-a7262291ae49): created successfully
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e38a92-2896-4e69-9de2-d061765f2081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Flow 'volume_create_manager' (b853f8f3-1385-485b-b61e-00703ec285dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:18:09 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-3a35df37-2bc3-4c1f-8928-9cfe7acc2fdb tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Created volume successfully.
Nov 19 13:18:09 devstack sudo[102160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc
Nov 19 13:18:09 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:09 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-878a0af2-508c-4af9-8215-90badf7a15c0 tempest-VolumeDependencyTests-1207279966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.464s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-878a0af2-508c-4af9-8215-90badf7a15c0 tempest-VolumeDependencyTests-1207279966 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:18:09 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-878a0af2-508c-4af9-8215-90badf7a15c0 tempest-VolumeDependencyTests-1207279966 None] Deleted volume successfully.
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-878a0af2-508c-4af9-8215-90badf7a15c0 tempest-VolumeDependencyTests-1207279966 None] Lock "cinder-cc07a169-fdb0-4df6-9104-e209b9a7d92b-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:09 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-069ddd8a-4dc0-4143-8882-2ba9de0d04ad tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-aa438c09-882f-4b56-8d1b-a1cbfb3fe648" returned: 0 in 0.616s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:09 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-069ddd8a-4dc0-4143-8882-2ba9de0d04ad tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-aa438c09-882f-4b56-8d1b-a1cbfb3fe648 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:09 devstack sudo[102166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-aa438c09-882f-4b56-8d1b-a1cbfb3fe648
Nov 19 13:18:09 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:10 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b2a84f04-498d-424e-b56f-45676553e28a tempest-SnapshotDependencyTests-73392086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc" returned: 0 in 0.548s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b2a84f04-498d-424e-b56f-45676553e28a tempest-SnapshotDependencyTests-73392086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.1218bea4-e814-42c4-90ea-4932dac27c3e 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:10 devstack sudo[102171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.1218bea4-e814-42c4-90ea-4932dac27c3e 1G
Nov 19 13:18:10 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:10 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-069ddd8a-4dc0-4143-8882-2ba9de0d04ad tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-aa438c09-882f-4b56-8d1b-a1cbfb3fe648" returned: 0 in 0.555s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-069ddd8a-4dc0-4143-8882-2ba9de0d04ad tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-quobyte-aa438c09-882f-4b56-8d1b-a1cbfb3fe648" released by "delete_volume" :: held 1.196s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-069ddd8a-4dc0-4143-8882-2ba9de0d04ad tempest-CreateVolumesFromSnapshotTest-287984160 None] Created reservations ['9f361d23-05cd-46a4-bed9-7d5454f174dc', 'e271c127-bc8e-46a7-89f7-f049b906651e', '24bcea26-9134-4e0f-925b-0c25af80c757', 'c44d469f-0a44-4aa0-adff-4eb56e9941fe'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-069ddd8a-4dc0-4143-8882-2ba9de0d04ad tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-069ddd8a-4dc0-4143-8882-2ba9de0d04ad tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-069ddd8a-4dc0-4143-8882-2ba9de0d04ad tempest-CreateVolumesFromSnapshotTest-287984160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-069ddd8a-4dc0-4143-8882-2ba9de0d04ad tempest-CreateVolumesFromSnapshotTest-287984160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-069ddd8a-4dc0-4143-8882-2ba9de0d04ad tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-069ddd8a-4dc0-4143-8882-2ba9de0d04ad tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:10 devstack sudo[102177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:18:10 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:18:10 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Flow 'volume_create_manager' (4bfac36e-8ab2-45ad-88a8-20f3d6762698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ba4729-ad9c-46cf-8b8f-3779c7617959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b2a84f04-498d-424e-b56f-45676553e28a tempest-SnapshotDependencyTests-73392086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.1218bea4-e814-42c4-90ea-4932dac27c3e 1G" returned: 0 in 0.672s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b2a84f04-498d-424e-b56f-45676553e28a tempest-SnapshotDependencyTests-73392086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1ec2305-6bae-42a7-9220-5547071969cc -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.1218bea4-e814-42c4-90ea-4932dac27c3e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ba4729-ad9c-46cf-8b8f-3779c7617959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-876613358',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a55c0daf-d2bb-45f7-addd-fc24c4f7aa39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2816e7c6a57e4c2f93f7ef435b46cf17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:18:11Z,use_quota=True,user_id='6c7d85ddf16544f2a9e4df676ec39916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324aef48-7a8e-4761-91fa-cef36e9edebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324aef48-7a8e-4761-91fa-cef36e9edebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d655c92c-3365-45d1-813c-62dea6465fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d655c92c-3365-45d1-813c-62dea6465fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a55c0daf-d2bb-45f7-addd-fc24c4f7aa39', 'volume_name': 'volume-a55c0daf-d2bb-45f7-addd-fc24c4f7aa39', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5208d89-8c89-4bcc-b1c2-0f6976264717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5208d89-8c89-4bcc-b1c2-0f6976264717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa5a0e1-d5ac-4361-8e9d-cc316d9dd462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:10 devstack sudo[102179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1ec2305-6bae-42a7-9220-5547071969cc -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.1218bea4-e814-42c4-90ea-4932dac27c3e
Nov 19 13:18:10 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Volume a55c0daf-d2bb-45f7-addd-fc24c4f7aa39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a55c0daf-d2bb-45f7-addd-fc24c4f7aa39', 'volume_size': 1}
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:10 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Flow 'volume_create_manager' (75c30a34-24d7-4aca-a3fc-8aca97152172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:18:10 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76dd7b96-b7e6-45fc-a10d-7d3d8084fc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76dd7b96-b7e6-45fc-a10d-7d3d8084fc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1525849315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ad96d27-ee16-42a2-be0c-70905625223c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2816e7c6a57e4c2f93f7ef435b46cf17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:18:11Z,use_quota=True,user_id='6c7d85ddf16544f2a9e4df676ec39916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5c8ad9c-b740-4c2d-8fc3-4854d3cdc348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5c8ad9c-b740-4c2d-8fc3-4854d3cdc348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc2cc2e3-1789-4d68-8de6-d882fc8d7dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc2cc2e3-1789-4d68-8de6-d882fc8d7dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ad96d27-ee16-42a2-be0c-70905625223c', 'volume_name': 'volume-1ad96d27-ee16-42a2-be0c-70905625223c', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2800d29e-5a51-43e1-973c-01a85875b692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2800d29e-5a51-43e1-973c-01a85875b692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a09e42-5eb1-4176-9da5-f37a673672af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:11 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Volume 1ad96d27-ee16-42a2-be0c-70905625223c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ad96d27-ee16-42a2-be0c-70905625223c', 'volume_size': 1}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Flow 'volume_create_manager' (33389776-1726-4be7-8295-9fe5af1762cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44ef4ae-dec4-4f57-8cc3-8311a28db21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44ef4ae-dec4-4f57-8cc3-8311a28db21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1324937084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd1d3ee5-3aec-4382-8360-bb46786a3b87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2816e7c6a57e4c2f93f7ef435b46cf17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:18:11Z,use_quota=True,user_id='6c7d85ddf16544f2a9e4df676ec39916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba7d5c1c-bc52-4f48-95ee-df1a478d6560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba7d5c1c-bc52-4f48-95ee-df1a478d6560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b48259e-53f2-4671-b230-b34c1b39abc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b48259e-53f2-4671-b230-b34c1b39abc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd1d3ee5-3aec-4382-8360-bb46786a3b87', 'volume_name': 'volume-bd1d3ee5-3aec-4382-8360-bb46786a3b87', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fafb25e2-1d44-4b22-871e-c01ac1b5bf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fafb25e2-1d44-4b22-871e-c01ac1b5bf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795a1bcc-4747-4faf-9116-96c31ccc00bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:11 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Volume bd1d3ee5-3aec-4382-8360-bb46786a3b87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd1d3ee5-3aec-4382-8360-bb46786a3b87', 'volume_size': 1}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:11 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-069ddd8a-4dc0-4143-8882-2ba9de0d04ad tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.786s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-069ddd8a-4dc0-4143-8882-2ba9de0d04ad tempest-CreateVolumesFromSnapshotTest-287984160 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:18:11 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-069ddd8a-4dc0-4143-8882-2ba9de0d04ad tempest-CreateVolumesFromSnapshotTest-287984160 None] Deleted volume successfully.
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-069ddd8a-4dc0-4143-8882-2ba9de0d04ad tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-aa438c09-882f-4b56-8d1b-a1cbfb3fe648-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-bb71b898-045d-4262-b5b8-a8149ba27df5 tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "cinder-16071d53-5b7e-4053-8b7f-9fd6dc4ee25a-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-bb71b898-045d-4262-b5b8-a8149ba27df5 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-16071d53-5b7e-4053-8b7f-9fd6dc4ee25a-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-bb71b898-045d-4262-b5b8-a8149ba27df5 tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "cinder-quobyte-16071d53-5b7e-4053-8b7f-9fd6dc4ee25a" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:11 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b2a84f04-498d-424e-b56f-45676553e28a tempest-SnapshotDependencyTests-73392086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1ec2305-6bae-42a7-9220-5547071969cc -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.1218bea4-e814-42c4-90ea-4932dac27c3e" returned: 0 in 0.775s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:11 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-b2a84f04-498d-424e-b56f-45676553e28a tempest-SnapshotDependencyTests-73392086 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.1218bea4-e814-42c4-90ea-4932dac27c3e is being set with open permissions: ugo+rw
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b2a84f04-498d-424e-b56f-45676553e28a tempest-SnapshotDependencyTests-73392086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.1218bea4-e814-42c4-90ea-4932dac27c3e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-bb71b898-045d-4262-b5b8-a8149ba27df5 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-quobyte-16071d53-5b7e-4053-8b7f-9fd6dc4ee25a" acquired by "delete_volume" :: waited 0.039s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[059da44d-a165-42f2-a383-7858cb708d92]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-bb71b898-045d-4262-b5b8-a8149ba27df5 tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-16071d53-5b7e-4053-8b7f-9fd6dc4ee25a {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:11 devstack sudo[102185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.1218bea4-e814-42c4-90ea-4932dac27c3e
Nov 19 13:18:11 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Flow 'volume_create_manager' (364d8160-0727-4114-9e9c-1d9c574f55fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4259e9fa-0e7f-4386-8d5f-e438430107ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4259e9fa-0e7f-4386-8d5f-e438430107ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-294075617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5509e0d7-5ca9-49cd-a038-018bbe5dff9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2816e7c6a57e4c2f93f7ef435b46cf17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:18:12Z,use_quota=True,user_id='6c7d85ddf16544f2a9e4df676ec39916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6440bb92-fdb8-4ca8-8370-f717d5b017bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6440bb92-fdb8-4ca8-8370-f717d5b017bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0def6ab9-dd09-4c97-a419-6c08b448106a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0def6ab9-dd09-4c97-a419-6c08b448106a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5509e0d7-5ca9-49cd-a038-018bbe5dff9d', 'volume_name': 'volume-5509e0d7-5ca9-49cd-a038-018bbe5dff9d', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (effa5088-164f-4934-82d6-e97f5542a7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (effa5088-164f-4934-82d6-e97f5542a7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bffb4763-a789-47e1-94f3-2ca0ec596340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:11 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Volume 5509e0d7-5ca9-49cd-a038-018bbe5dff9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5509e0d7-5ca9-49cd-a038-018bbe5dff9d', 'volume_size': 1}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:18:11 devstack sudo[102187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-16071d53-5b7e-4053-8b7f-9fd6dc4ee25a
Nov 19 13:18:11 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Flow 'volume_create_manager' (95da2483-5631-445a-8858-dd7641b7f92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3423c2ce-eedd-41ce-90d3-900b202e9ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3423c2ce-eedd-41ce-90d3-900b202e9ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1100638046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947d8686-110a-4638-b26a-ff6272706373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2816e7c6a57e4c2f93f7ef435b46cf17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:18:12Z,use_quota=True,user_id='6c7d85ddf16544f2a9e4df676ec39916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f059382-1871-4106-b16c-23d24da4213d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f059382-1871-4106-b16c-23d24da4213d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fe920dc-8005-4c48-b071-91d605f7ca79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fe920dc-8005-4c48-b071-91d605f7ca79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '947d8686-110a-4638-b26a-ff6272706373', 'volume_name': 'volume-947d8686-110a-4638-b26a-ff6272706373', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d306c594-93ee-4dfe-a54f-a67c84a9615e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d306c594-93ee-4dfe-a54f-a67c84a9615e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bebf8cfc-77eb-4762-be97-bb25edf071e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:11 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Volume 947d8686-110a-4638-b26a-ff6272706373: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-947d8686-110a-4638-b26a-ff6272706373', 'volume_size': 1}
Nov 19 13:18:11 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:12 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b2a84f04-498d-424e-b56f-45676553e28a tempest-SnapshotDependencyTests-73392086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.1218bea4-e814-42c4-90ea-4932dac27c3e" returned: 0 in 0.538s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b2a84f04-498d-424e-b56f-45676553e28a tempest-SnapshotDependencyTests-73392086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:12 devstack sudo[102190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.info
Nov 19 13:18:12 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:12 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-bb71b898-045d-4262-b5b8-a8149ba27df5 tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-16071d53-5b7e-4053-8b7f-9fd6dc4ee25a" returned: 0 in 0.629s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-bb71b898-045d-4262-b5b8-a8149ba27df5 tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-16071d53-5b7e-4053-8b7f-9fd6dc4ee25a {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:12 devstack sudo[102195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-16071d53-5b7e-4053-8b7f-9fd6dc4ee25a
Nov 19 13:18:12 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:12 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b2a84f04-498d-424e-b56f-45676553e28a tempest-SnapshotDependencyTests-73392086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.info" returned: 0 in 0.430s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:12 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-b2a84f04-498d-424e-b56f-45676553e28a tempest-SnapshotDependencyTests-73392086 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.info is being set with open permissions: ugo+rw
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b2a84f04-498d-424e-b56f-45676553e28a tempest-SnapshotDependencyTests-73392086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:12 devstack sudo[102198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.info
Nov 19 13:18:12 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:12 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-bb71b898-045d-4262-b5b8-a8149ba27df5 tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-16071d53-5b7e-4053-8b7f-9fd6dc4ee25a" returned: 0 in 0.485s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-bb71b898-045d-4262-b5b8-a8149ba27df5 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-quobyte-16071d53-5b7e-4053-8b7f-9fd6dc4ee25a" released by "delete_volume" :: held 1.157s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:UPDATE=198,cinder:SELECT=119,cinder:INSERT=35,cinder:DELETE=16 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=127,cinder:INSERT=37,cinder:UPDATE=173,cinder:DELETE=23 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-bb71b898-045d-4262-b5b8-a8149ba27df5 tempest-CreateVolumesFromSnapshotTest-287984160 None] Created reservations ['6de09f1e-26ec-4bab-a150-6e224f58fb36', '4078ebf3-79ba-4783-8fa8-2ae6c73dd9aa', '1e969e24-44bf-440f-a27c-2d44d1f73d5a', '5ed0ea65-202a-4986-890e-0aea94a61db4'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-bb71b898-045d-4262-b5b8-a8149ba27df5 tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-bb71b898-045d-4262-b5b8-a8149ba27df5 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-bb71b898-045d-4262-b5b8-a8149ba27df5 tempest-CreateVolumesFromSnapshotTest-287984160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-bb71b898-045d-4262-b5b8-a8149ba27df5 tempest-CreateVolumesFromSnapshotTest-287984160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-bb71b898-045d-4262-b5b8-a8149ba27df5 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-bb71b898-045d-4262-b5b8-a8149ba27df5 tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:12 devstack sudo[102201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:18:12 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:12 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b2a84f04-498d-424e-b56f-45676553e28a tempest-SnapshotDependencyTests-73392086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.info" returned: 0 in 0.423s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b2a84f04-498d-424e-b56f-45676553e28a tempest-SnapshotDependencyTests-73392086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.440s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.150s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-876613358',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a55c0daf-d2bb-45f7-addd-fc24c4f7aa39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2816e7c6a57e4c2f93f7ef435b46cf17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:18:11Z,use_quota=True,user_id='6c7d85ddf16544f2a9e4df676ec39916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Creating volume a55c0daf-d2bb-45f7-addd-fc24c4f7aa39 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:18:12 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:18:12 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a55c0daf-d2bb-45f7-addd-fc24c4f7aa39 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:12 devstack sudo[102205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a55c0daf-d2bb-45f7-addd-fc24c4f7aa39 1073741824
Nov 19 13:18:12 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:12 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-b2a84f04-498d-424e-b56f-45676553e28a tempest-SnapshotDependencyTests-73392086 None] Create snapshot completed successfully
Nov 19 13:18:13 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-bb71b898-045d-4262-b5b8-a8149ba27df5 tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.447s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-bb71b898-045d-4262-b5b8-a8149ba27df5 tempest-CreateVolumesFromSnapshotTest-287984160 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:18:13 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-bb71b898-045d-4262-b5b8-a8149ba27df5 tempest-CreateVolumesFromSnapshotTest-287984160 None] Deleted volume successfully.
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-bb71b898-045d-4262-b5b8-a8149ba27df5 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-16071d53-5b7e-4053-8b7f-9fd6dc4ee25a-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:13 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a55c0daf-d2bb-45f7-addd-fc24c4f7aa39 1073741824" returned: 0 in 0.541s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a55c0daf-d2bb-45f7-addd-fc24c4f7aa39 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:13 devstack sudo[102211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a55c0daf-d2bb-45f7-addd-fc24c4f7aa39
Nov 19 13:18:13 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8617fec1-f900-43e3-8fe5-5b9d09f80efc tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "cinder-fc505c5e-6740-4a34-b5f2-c5e94f0a239f-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8617fec1-f900-43e3-8fe5-5b9d09f80efc tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-fc505c5e-6740-4a34-b5f2-c5e94f0a239f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8617fec1-f900-43e3-8fe5-5b9d09f80efc tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "cinder-quobyte-fc505c5e-6740-4a34-b5f2-c5e94f0a239f" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8617fec1-f900-43e3-8fe5-5b9d09f80efc tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-quobyte-fc505c5e-6740-4a34-b5f2-c5e94f0a239f" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c4fe28-c15a-4567-b812-3d5a1370af46]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8617fec1-f900-43e3-8fe5-5b9d09f80efc tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fc505c5e-6740-4a34-b5f2-c5e94f0a239f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Flow 'volume_create_manager' (15657e5f-5584-469d-aa2d-12e04b51b7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e7c213e-74ee-4875-8667-3100e8575beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e7c213e-74ee-4875-8667-3100e8575beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=922ebd20-72dc-470b-a66a-c35008990360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e81e4ca6024ff2b2ce87d0811adb36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1218bea4-e814-42c4-90ea-4932dac27c3e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:18:14Z,use_quota=True,user_id='ca34ddd87c9a4c2eac433a3c13b9952b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f9908c-3585-44e9-a2d5-f45f406d6073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f9908c-3585-44e9-a2d5-f45f406d6073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:13 devstack sudo[102213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fc505c5e-6740-4a34-b5f2-c5e94f0a239f
Nov 19 13:18:13 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29dcc282-bf8e-4542-ab89-f8ad487d4c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29dcc282-bf8e-4542-ab89-f8ad487d4c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '922ebd20-72dc-470b-a66a-c35008990360', 'volume_name': 'volume-922ebd20-72dc-470b-a66a-c35008990360', 'volume_size': 1, 'snapshot_id': '1218bea4-e814-42c4-90ea-4932dac27c3e'}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a8306d-96e8-4d8c-9e85-995f2d06c617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a8306d-96e8-4d8c-9e85-995f2d06c617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc5505b4-8b9c-43cc-9efd-fb7e18f5778d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:13 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Volume 922ebd20-72dc-470b-a66a-c35008990360: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-922ebd20-72dc-470b-a66a-c35008990360', 'volume_size': 1, 'snapshot_id': '1218bea4-e814-42c4-90ea-4932dac27c3e'}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:13 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a55c0daf-d2bb-45f7-addd-fc24c4f7aa39" returned: 0 in 0.475s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.903s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1525849315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ad96d27-ee16-42a2-be0c-70905625223c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2816e7c6a57e4c2f93f7ef435b46cf17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:18:11Z,use_quota=True,user_id='6c7d85ddf16544f2a9e4df676ec39916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Creating volume 1ad96d27-ee16-42a2-be0c-70905625223c {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:18:13 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1ad96d27-ee16-42a2-be0c-70905625223c 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa5a0e1-d5ac-4361-8e9d-cc316d9dd462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a55c0daf-d2bb-45f7-addd-fc24c4f7aa39', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:13 devstack sudo[102216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1ad96d27-ee16-42a2-be0c-70905625223c 1073741824
Nov 19 13:18:13 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7bdd7f-fe96-4faa-8da5-305bd23a07c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:13 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:14 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Volume volume-a55c0daf-d2bb-45f7-addd-fc24c4f7aa39 (a55c0daf-d2bb-45f7-addd-fc24c4f7aa39): created successfully
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7bdd7f-fe96-4faa-8da5-305bd23a07c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Flow 'volume_create_manager' (4bfac36e-8ab2-45ad-88a8-20f3d6762698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:18:14 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-a185fb04-4477-4664-9ea4-53869e7397af tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Created volume successfully.
Nov 19 13:18:14 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8617fec1-f900-43e3-8fe5-5b9d09f80efc tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fc505c5e-6740-4a34-b5f2-c5e94f0a239f" returned: 0 in 0.598s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8617fec1-f900-43e3-8fe5-5b9d09f80efc tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fc505c5e-6740-4a34-b5f2-c5e94f0a239f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:14 devstack sudo[102222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fc505c5e-6740-4a34-b5f2-c5e94f0a239f
Nov 19 13:18:14 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:14 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1ad96d27-ee16-42a2-be0c-70905625223c 1073741824" returned: 0 in 0.528s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1ad96d27-ee16-42a2-be0c-70905625223c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:14 devstack sudo[102226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1ad96d27-ee16-42a2-be0c-70905625223c
Nov 19 13:18:14 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:14 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8617fec1-f900-43e3-8fe5-5b9d09f80efc tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-fc505c5e-6740-4a34-b5f2-c5e94f0a239f" returned: 0 in 0.450s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8617fec1-f900-43e3-8fe5-5b9d09f80efc tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-quobyte-fc505c5e-6740-4a34-b5f2-c5e94f0a239f" released by "delete_volume" :: held 1.085s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-8617fec1-f900-43e3-8fe5-5b9d09f80efc tempest-CreateVolumesFromSnapshotTest-287984160 None] Created reservations ['7cec5e7b-b6b3-4090-82c1-0e3c3946c311', '5537e936-71a7-46be-8757-4d24acfb0beb', 'ab89b19b-9e93-4dde-9af7-6a7ed1c77fdb', '7eb2b7ed-6024-4b8b-9cdf-418f7237b917'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8617fec1-f900-43e3-8fe5-5b9d09f80efc tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8617fec1-f900-43e3-8fe5-5b9d09f80efc tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8617fec1-f900-43e3-8fe5-5b9d09f80efc tempest-CreateVolumesFromSnapshotTest-287984160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8617fec1-f900-43e3-8fe5-5b9d09f80efc tempest-CreateVolumesFromSnapshotTest-287984160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8617fec1-f900-43e3-8fe5-5b9d09f80efc tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8617fec1-f900-43e3-8fe5-5b9d09f80efc tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:14 devstack sudo[102229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:18:14 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:14 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1ad96d27-ee16-42a2-be0c-70905625223c" returned: 0 in 0.463s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.692s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1324937084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd1d3ee5-3aec-4382-8360-bb46786a3b87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2816e7c6a57e4c2f93f7ef435b46cf17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:18:11Z,use_quota=True,user_id='6c7d85ddf16544f2a9e4df676ec39916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Creating volume bd1d3ee5-3aec-4382-8360-bb46786a3b87 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:18:14 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-bd1d3ee5-3aec-4382-8360-bb46786a3b87 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:14 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a09e42-5eb1-4176-9da5-f37a673672af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ad96d27-ee16-42a2-be0c-70905625223c', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:15 devstack sudo[102232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-bd1d3ee5-3aec-4382-8360-bb46786a3b87 1073741824
Nov 19 13:18:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ab83f2-a8d9-45f2-8594-2e07599623cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:15 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:15 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Volume volume-1ad96d27-ee16-42a2-be0c-70905625223c (1ad96d27-ee16-42a2-be0c-70905625223c): created successfully
Nov 19 13:18:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ab83f2-a8d9-45f2-8594-2e07599623cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:15 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Flow 'volume_create_manager' (75c30a34-24d7-4aca-a3fc-8aca97152172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:18:15 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-e887dc5d-3635-47cc-bf22-9b448dd464d4 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Created volume successfully.
Nov 19 13:18:15 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8617fec1-f900-43e3-8fe5-5b9d09f80efc tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.428s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:15 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-8617fec1-f900-43e3-8fe5-5b9d09f80efc tempest-CreateVolumesFromSnapshotTest-287984160 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:18:15 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-8617fec1-f900-43e3-8fe5-5b9d09f80efc tempest-CreateVolumesFromSnapshotTest-287984160 None] Deleted volume successfully.
Nov 19 13:18:15 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8617fec1-f900-43e3-8fe5-5b9d09f80efc tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-fc505c5e-6740-4a34-b5f2-c5e94f0a239f-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:15 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-bd1d3ee5-3aec-4382-8360-bb46786a3b87 1073741824" returned: 0 in 0.582s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-bd1d3ee5-3aec-4382-8360-bb46786a3b87 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:15 devstack sudo[102238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-bd1d3ee5-3aec-4382-8360-bb46786a3b87
Nov 19 13:18:15 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:15 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6437dee5-cb95-470e-8f79-1ddd30844253 tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "cinder-e7b172f0-6d52-412c-ae63-5efa27dec95f-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:15 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6437dee5-cb95-470e-8f79-1ddd30844253 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-e7b172f0-6d52-412c-ae63-5efa27dec95f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:15 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6437dee5-cb95-470e-8f79-1ddd30844253 tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "cinder-quobyte-e7b172f0-6d52-412c-ae63-5efa27dec95f" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:15 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6437dee5-cb95-470e-8f79-1ddd30844253 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-quobyte-e7b172f0-6d52-412c-ae63-5efa27dec95f" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:15 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffe89d7-fc8a-46b8-9295-d393a0f2b93a]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:15 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6437dee5-cb95-470e-8f79-1ddd30844253 tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e7b172f0-6d52-412c-ae63-5efa27dec95f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:16 devstack sudo[102240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e7b172f0-6d52-412c-ae63-5efa27dec95f
Nov 19 13:18:16 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:16 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-bd1d3ee5-3aec-4382-8360-bb46786a3b87" returned: 0 in 0.467s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:16 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:18:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.314s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:16 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-294075617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5509e0d7-5ca9-49cd-a038-018bbe5dff9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2816e7c6a57e4c2f93f7ef435b46cf17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:18:12Z,use_quota=True,user_id='6c7d85ddf16544f2a9e4df676ec39916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:18:16 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Creating volume 5509e0d7-5ca9-49cd-a038-018bbe5dff9d {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:18:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:16 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:16 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:16 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:18:16 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:18:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5509e0d7-5ca9-49cd-a038-018bbe5dff9d 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795a1bcc-4747-4faf-9116-96c31ccc00bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd1d3ee5-3aec-4382-8360-bb46786a3b87', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:16 devstack sudo[102243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5509e0d7-5ca9-49cd-a038-018bbe5dff9d 1073741824
Nov 19 13:18:16 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e903bb9c-6bff-43e7-9aa8-76096b3ab20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:16 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Volume volume-bd1d3ee5-3aec-4382-8360-bb46786a3b87 (bd1d3ee5-3aec-4382-8360-bb46786a3b87): created successfully
Nov 19 13:18:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e903bb9c-6bff-43e7-9aa8-76096b3ab20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:16 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Flow 'volume_create_manager' (33389776-1726-4be7-8295-9fe5af1762cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:18:16 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-eae597f9-eaae-4b85-862c-e2a4a0d5730c tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Created volume successfully.
Nov 19 13:18:16 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6437dee5-cb95-470e-8f79-1ddd30844253 tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e7b172f0-6d52-412c-ae63-5efa27dec95f" returned: 0 in 0.577s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6437dee5-cb95-470e-8f79-1ddd30844253 tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e7b172f0-6d52-412c-ae63-5efa27dec95f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:16 devstack sudo[102251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e7b172f0-6d52-412c-ae63-5efa27dec95f
Nov 19 13:18:16 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:16 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5509e0d7-5ca9-49cd-a038-018bbe5dff9d 1073741824" returned: 0 in 0.524s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5509e0d7-5ca9-49cd-a038-018bbe5dff9d {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:16 devstack sudo[102253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5509e0d7-5ca9-49cd-a038-018bbe5dff9d
Nov 19 13:18:16 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:16 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:16 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6437dee5-cb95-470e-8f79-1ddd30844253 tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-e7b172f0-6d52-412c-ae63-5efa27dec95f" returned: 0 in 0.468s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:16 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6437dee5-cb95-470e-8f79-1ddd30844253 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-quobyte-e7b172f0-6d52-412c-ae63-5efa27dec95f" released by "delete_volume" :: held 1.086s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:16 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-6437dee5-cb95-470e-8f79-1ddd30844253 tempest-CreateVolumesFromSnapshotTest-287984160 None] Created reservations ['f1dea557-b454-4213-a476-b4f708eb7de7', '0b41a58f-beb7-4cb2-bef6-8bc28e12f264', '3a38944f-3a26-496e-8e65-42b5e61bb332', 'a1029b99-b4e2-47b1-a7fb-acc9f855fe34'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6437dee5-cb95-470e-8f79-1ddd30844253 tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6437dee5-cb95-470e-8f79-1ddd30844253 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6437dee5-cb95-470e-8f79-1ddd30844253 tempest-CreateVolumesFromSnapshotTest-287984160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6437dee5-cb95-470e-8f79-1ddd30844253 tempest-CreateVolumesFromSnapshotTest-287984160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6437dee5-cb95-470e-8f79-1ddd30844253 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6437dee5-cb95-470e-8f79-1ddd30844253 tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:17 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5509e0d7-5ca9-49cd-a038-018bbe5dff9d" returned: 0 in 0.478s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.187s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1100638046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947d8686-110a-4638-b26a-ff6272706373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2816e7c6a57e4c2f93f7ef435b46cf17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:18:12Z,use_quota=True,user_id='6c7d85ddf16544f2a9e4df676ec39916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Creating volume 947d8686-110a-4638-b26a-ff6272706373 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:17 devstack sudo[102257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:17 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:18:17 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-947d8686-110a-4638-b26a-ff6272706373 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bffb4763-a789-47e1-94f3-2ca0ec596340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5509e0d7-5ca9-49cd-a038-018bbe5dff9d', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f8b622-4e90-41b5-8a51-642e0144cfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:17 devstack sudo[102259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-947d8686-110a-4638-b26a-ff6272706373 1073741824
Nov 19 13:18:17 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:17 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Volume volume-5509e0d7-5ca9-49cd-a038-018bbe5dff9d (5509e0d7-5ca9-49cd-a038-018bbe5dff9d): created successfully
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f8b622-4e90-41b5-8a51-642e0144cfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Flow 'volume_create_manager' (364d8160-0727-4114-9e9c-1d9c574f55fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:18:17 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-7062bac3-20db-4426-aec6-55db38dda384 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Created volume successfully.
Nov 19 13:18:17 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6437dee5-cb95-470e-8f79-1ddd30844253 tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.425s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-6437dee5-cb95-470e-8f79-1ddd30844253 tempest-CreateVolumesFromSnapshotTest-287984160 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:18:17 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-6437dee5-cb95-470e-8f79-1ddd30844253 tempest-CreateVolumesFromSnapshotTest-287984160 None] Deleted volume successfully.
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-6437dee5-cb95-470e-8f79-1ddd30844253 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-e7b172f0-6d52-412c-ae63-5efa27dec95f-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:17 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-947d8686-110a-4638-b26a-ff6272706373 1073741824" returned: 0 in 0.579s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:17 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-947d8686-110a-4638-b26a-ff6272706373 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:17 devstack sudo[102266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-947d8686-110a-4638-b26a-ff6272706373
Nov 19 13:18:17 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0cf6693e-09bf-4f37-90e4-4f3c5cc8f7ec tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "cinder-d5314238-62f7-43ab-9120-42913c27a24f-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0cf6693e-09bf-4f37-90e4-4f3c5cc8f7ec tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-d5314238-62f7-43ab-9120-42913c27a24f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0cf6693e-09bf-4f37-90e4-4f3c5cc8f7ec tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "cinder-quobyte-d5314238-62f7-43ab-9120-42913c27a24f" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0cf6693e-09bf-4f37-90e4-4f3c5cc8f7ec tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-quobyte-d5314238-62f7-43ab-9120-42913c27a24f" acquired by "delete_volume" :: waited 0.016s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa65926-ba91-44c4-aac8-d7c2cfa3f6a3]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0cf6693e-09bf-4f37-90e4-4f3c5cc8f7ec tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5314238-62f7-43ab-9120-42913c27a24f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:18 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-947d8686-110a-4638-b26a-ff6272706373" returned: 0 in 0.466s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.216s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Acquiring lock "cinder-quobyte-1218bea4-e814-42c4-90ea-4932dac27c3e-922ebd20-72dc-470b-a66a-c35008990360" by "_create_volume_from_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bebf8cfc-77eb-4762-be97-bb25edf071e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-947d8686-110a-4638-b26a-ff6272706373', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc69e915-49a0-42f1-b117-ad3dd7679eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:18 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Volume volume-947d8686-110a-4638-b26a-ff6272706373 (947d8686-110a-4638-b26a-ff6272706373): created successfully
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc69e915-49a0-42f1-b117-ad3dd7679eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Flow 'volume_create_manager' (95da2483-5631-445a-8858-dd7641b7f92c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Lock "cinder-quobyte-1218bea4-e814-42c4-90ea-4932dac27c3e-922ebd20-72dc-470b-a66a-c35008990360" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Creating volume 922ebd20-72dc-470b-a66a-c35008990360 from snapshot 1218bea4-e814-42c4-90ea-4932dac27c3e {{(pid=80839) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Acquiring lock "cinder-quobyte-922ebd20-72dc-470b-a66a-c35008990360" by "_copy_volume_from_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:18 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-7b40316e-d164-4a94-9661-5198de7679fa tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Created volume successfully.
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Lock "cinder-quobyte-922ebd20-72dc-470b-a66a-c35008990360" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] snapshot: 1218bea4-e814-42c4-90ea-4932dac27c3e, volume: 922ebd20-72dc-470b-a66a-c35008990360,  {{(pid=80839) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:392}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:18 devstack sudo[102269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5314238-62f7-43ab-9120-42913c27a24f
Nov 19 13:18:18 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d1f92c-2d14-466a-82e5-6c7a480ae695]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.1218bea4-e814-42c4-90ea-4932dac27c3e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-32ae9b59-0086-4a29-9762-44389f51946b tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "cinder-947d8686-110a-4638-b26a-ff6272706373-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-32ae9b59-0086-4a29-9762-44389f51946b tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "cinder-947d8686-110a-4638-b26a-ff6272706373-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-32ae9b59-0086-4a29-9762-44389f51946b tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "cinder-quobyte-947d8686-110a-4638-b26a-ff6272706373" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-32ae9b59-0086-4a29-9762-44389f51946b tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "cinder-quobyte-947d8686-110a-4638-b26a-ff6272706373" acquired by "delete_volume" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:18 devstack sudo[102271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.1218bea4-e814-42c4-90ea-4932dac27c3e
Nov 19 13:18:18 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f21056f-de80-401b-9767-cb9e99c3cccb]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-32ae9b59-0086-4a29-9762-44389f51946b tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-947d8686-110a-4638-b26a-ff6272706373 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:18 devstack sudo[102273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-947d8686-110a-4638-b26a-ff6272706373
Nov 19 13:18:18 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:18 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0cf6693e-09bf-4f37-90e4-4f3c5cc8f7ec tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5314238-62f7-43ab-9120-42913c27a24f" returned: 0 in 0.628s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0cf6693e-09bf-4f37-90e4-4f3c5cc8f7ec tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5314238-62f7-43ab-9120-42913c27a24f {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:18 devstack sudo[102281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5314238-62f7-43ab-9120-42913c27a24f
Nov 19 13:18:18 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:18 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.1218bea4-e814-42c4-90ea-4932dac27c3e" returned: 0 in 0.575s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1ec2305-6bae-42a7-9220-5547071969cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc {{(pid=80839) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:411}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Creating direct copy from snapshot {{(pid=80839) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:419}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eaeec0c-9467-432f-91a9-cc56f6a35ec1]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:18 devstack sudo[102283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc
Nov 19 13:18:18 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:18 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-32ae9b59-0086-4a29-9762-44389f51946b tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-947d8686-110a-4638-b26a-ff6272706373" returned: 0 in 0.569s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:18 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-32ae9b59-0086-4a29-9762-44389f51946b tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-947d8686-110a-4638-b26a-ff6272706373 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:18 devstack sudo[102288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-947d8686-110a-4638-b26a-ff6272706373
Nov 19 13:18:18 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:19 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0cf6693e-09bf-4f37-90e4-4f3c5cc8f7ec tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-d5314238-62f7-43ab-9120-42913c27a24f" returned: 0 in 0.491s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:19 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0cf6693e-09bf-4f37-90e4-4f3c5cc8f7ec tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-quobyte-d5314238-62f7-43ab-9120-42913c27a24f" released by "delete_volume" :: held 1.143s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:19 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-0cf6693e-09bf-4f37-90e4-4f3c5cc8f7ec tempest-CreateVolumesFromSnapshotTest-287984160 None] Created reservations ['7978e2f4-2845-4c70-85c3-cb6e1088d217', 'b0e11c42-7785-415d-a5f1-5a55070ba1d1', '76c7f733-67e5-4d23-8a14-a260ffc518cc', 'a4ce4036-4bc4-4b56-86a1-2852976bb7c1'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:18:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0cf6693e-09bf-4f37-90e4-4f3c5cc8f7ec tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0cf6693e-09bf-4f37-90e4-4f3c5cc8f7ec tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:19 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0cf6693e-09bf-4f37-90e4-4f3c5cc8f7ec tempest-CreateVolumesFromSnapshotTest-287984160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:19 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0cf6693e-09bf-4f37-90e4-4f3c5cc8f7ec tempest-CreateVolumesFromSnapshotTest-287984160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0cf6693e-09bf-4f37-90e4-4f3c5cc8f7ec tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0cf6693e-09bf-4f37-90e4-4f3c5cc8f7ec tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:19 devstack sudo[102291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:18:19 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:19 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-32ae9b59-0086-4a29-9762-44389f51946b tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-947d8686-110a-4638-b26a-ff6272706373" returned: 0 in 0.447s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:19 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-32ae9b59-0086-4a29-9762-44389f51946b tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "cinder-quobyte-947d8686-110a-4638-b26a-ff6272706373" released by "delete_volume" :: held 1.043s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:19 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-32ae9b59-0086-4a29-9762-44389f51946b tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Created reservations ['927658b9-8e93-4e55-ab34-99c62e00c248', '56a1fd55-858b-4d98-b9bc-e052d601ff58', '7c01b443-6920-4377-808f-bf2bcb6887a7', '56467d51-ba2e-40f6-b0f8-74bc461857f9'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:18:19 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc" returned: 0 in 0.629s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:19 devstack cinder-volume[80839]: DEBUG cinder.utils [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Path /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-922ebd20-72dc-470b-a66a-c35008990360 not found in is_blk_device check {{(pid=80839) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Nov 19 13:18:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-922ebd20-72dc-470b-a66a-c35008990360 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:19 devstack sudo[102297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-922ebd20-72dc-470b-a66a-c35008990360
Nov 19 13:18:19 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-32ae9b59-0086-4a29-9762-44389f51946b tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-32ae9b59-0086-4a29-9762-44389f51946b tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:19 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-32ae9b59-0086-4a29-9762-44389f51946b tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:19 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-32ae9b59-0086-4a29-9762-44389f51946b tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-32ae9b59-0086-4a29-9762-44389f51946b tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-32ae9b59-0086-4a29-9762-44389f51946b tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:19 devstack sudo[102299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:18:19 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:19 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:19 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0cf6693e-09bf-4f37-90e4-4f3c5cc8f7ec tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.464s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:19 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-0cf6693e-09bf-4f37-90e4-4f3c5cc8f7ec tempest-CreateVolumesFromSnapshotTest-287984160 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:18:19 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-0cf6693e-09bf-4f37-90e4-4f3c5cc8f7ec tempest-CreateVolumesFromSnapshotTest-287984160 None] Deleted volume successfully.
Nov 19 13:18:19 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0cf6693e-09bf-4f37-90e4-4f3c5cc8f7ec tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-d5314238-62f7-43ab-9120-42913c27a24f-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:20 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-32ae9b59-0086-4a29-9762-44389f51946b tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.653s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:20 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-32ae9b59-0086-4a29-9762-44389f51946b tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:18:20 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-32ae9b59-0086-4a29-9762-44389f51946b tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Deleted volume successfully.
Nov 19 13:18:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-32ae9b59-0086-4a29-9762-44389f51946b tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "cinder-947d8686-110a-4638-b26a-ff6272706373-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-cc6a5dc5-4f53-4dca-8819-158442af4b51 tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "cinder-388bea36-15d0-4f18-8080-894ddfa69756-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-cc6a5dc5-4f53-4dca-8819-158442af4b51 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-388bea36-15d0-4f18-8080-894ddfa69756-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-cc6a5dc5-4f53-4dca-8819-158442af4b51 tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "cinder-quobyte-ec4aefec-a859-46cb-a8df-f45b7f630bd7" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-cc6a5dc5-4f53-4dca-8819-158442af4b51 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-quobyte-ec4aefec-a859-46cb-a8df-f45b7f630bd7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-cc6a5dc5-4f53-4dca-8819-158442af4b51 tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "cinder-quobyte-388bea36-15d0-4f18-8080-894ddfa69756" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-15de3116-1c5c-4fa2-9a1f-ca33d6add4f1 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "cinder-5509e0d7-5ca9-49cd-a038-018bbe5dff9d-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-cc6a5dc5-4f53-4dca-8819-158442af4b51 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-quobyte-388bea36-15d0-4f18-8080-894ddfa69756" acquired by "_delete_snapshot" :: waited 0.072s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-cc6a5dc5-4f53-4dca-8819-158442af4b51 tempest-CreateVolumesFromSnapshotTest-287984160 None] Deleting offline snapshot 388bea36-15d0-4f18-8080-894ddfa69756 of volume ec4aefec-a859-46cb-a8df-f45b7f630bd7 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 13:18:20 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-cc6a5dc5-4f53-4dca-8819-158442af4b51 tempest-CreateVolumesFromSnapshotTest-287984160 None] snapshot_file for this snap is: volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7.388bea36-15d0-4f18-8080-894ddfa69756 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 13:18:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-15de3116-1c5c-4fa2-9a1f-ca33d6add4f1 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "cinder-5509e0d7-5ca9-49cd-a038-018bbe5dff9d-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:20 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2d4af3-9154-4582-96bb-224e90e27101]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cc6a5dc5-4f53-4dca-8819-158442af4b51 tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7.388bea36-15d0-4f18-8080-894ddfa69756 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-15de3116-1c5c-4fa2-9a1f-ca33d6add4f1 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "cinder-quobyte-5509e0d7-5ca9-49cd-a038-018bbe5dff9d" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:20 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-15de3116-1c5c-4fa2-9a1f-ca33d6add4f1 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "cinder-quobyte-5509e0d7-5ca9-49cd-a038-018bbe5dff9d" acquired by "delete_volume" :: waited 0.014s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:20 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d31982-d615-4a27-b669-fe6899f7aaaf]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:20 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-15de3116-1c5c-4fa2-9a1f-ca33d6add4f1 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5509e0d7-5ca9-49cd-a038-018bbe5dff9d {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:20 devstack sudo[102313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7.388bea36-15d0-4f18-8080-894ddfa69756
Nov 19 13:18:20 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:21 devstack sudo[102314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5509e0d7-5ca9-49cd-a038-018bbe5dff9d
Nov 19 13:18:21 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:21 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cc6a5dc5-4f53-4dca-8819-158442af4b51 tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7.388bea36-15d0-4f18-8080-894ddfa69756" returned: 0 in 0.989s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:21 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-cc6a5dc5-4f53-4dca-8819-158442af4b51 tempest-CreateVolumesFromSnapshotTest-287984160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:18:21 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d7fd70-3137-4d8a-8ea1-f0e4995b1994]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cc6a5dc5-4f53-4dca-8819-158442af4b51 tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:21 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-922ebd20-72dc-470b-a66a-c35008990360" returned: 0 in 2.255s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:21 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfd16cf-f8b7-4530-b619-abda799019c5]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:21 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:21 devstack sudo[102320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7
Nov 19 13:18:21 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:21 devstack sudo[102321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc
Nov 19 13:18:21 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:21 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-15de3116-1c5c-4fa2-9a1f-ca33d6add4f1 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5509e0d7-5ca9-49cd-a038-018bbe5dff9d" returned: 0 in 1.167s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-15de3116-1c5c-4fa2-9a1f-ca33d6add4f1 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5509e0d7-5ca9-49cd-a038-018bbe5dff9d {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:22 devstack sudo[102327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5509e0d7-5ca9-49cd-a038-018bbe5dff9d
Nov 19 13:18:22 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:22 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cc6a5dc5-4f53-4dca-8819-158442af4b51 tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7" returned: 0 in 0.554s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cc6a5dc5-4f53-4dca-8819-158442af4b51 tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7.388bea36-15d0-4f18-8080-894ddfa69756 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:22 devstack sudo[102334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7.388bea36-15d0-4f18-8080-894ddfa69756
Nov 19 13:18:22 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:22 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc" returned: 0 in 0.675s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG cinder.image.image_utils [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Image conversion details: src /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc, size 1024.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-922ebd20-72dc-470b-a66a-c35008990360 {{(pid=80839) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Nov 19 13:18:22 devstack cinder-volume[80839]: INFO cinder.image.image_utils [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Converted 1024.00 MB image at 453.88 MB/s
Nov 19 13:18:22 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-922ebd20-72dc-470b-a66a-c35008990360 is being set with open permissions: ugo+rw
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-922ebd20-72dc-470b-a66a-c35008990360 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:22 devstack sudo[102337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-922ebd20-72dc-470b-a66a-c35008990360
Nov 19 13:18:22 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:22 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-15de3116-1c5c-4fa2-9a1f-ca33d6add4f1 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-5509e0d7-5ca9-49cd-a038-018bbe5dff9d" returned: 0 in 0.477s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-15de3116-1c5c-4fa2-9a1f-ca33d6add4f1 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "cinder-quobyte-5509e0d7-5ca9-49cd-a038-018bbe5dff9d" released by "delete_volume" :: held 1.690s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-15de3116-1c5c-4fa2-9a1f-ca33d6add4f1 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Created reservations ['1411788f-47ff-4fc7-854e-1c3e3a7a3770', '1da2e4d3-30ad-4bad-aa5d-6add80d47b6f', '8e022cbb-31d9-4ce0-bb7e-7ed12d35fc2e', '44acd002-c1cd-467c-a376-ca29b20d0c50'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-15de3116-1c5c-4fa2-9a1f-ca33d6add4f1 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-15de3116-1c5c-4fa2-9a1f-ca33d6add4f1 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-15de3116-1c5c-4fa2-9a1f-ca33d6add4f1 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-15de3116-1c5c-4fa2-9a1f-ca33d6add4f1 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-15de3116-1c5c-4fa2-9a1f-ca33d6add4f1 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-15de3116-1c5c-4fa2-9a1f-ca33d6add4f1 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:22 devstack sudo[102340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:18:22 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:22 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cc6a5dc5-4f53-4dca-8819-158442af4b51 tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7.388bea36-15d0-4f18-8080-894ddfa69756" returned: 0 in 0.511s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cc6a5dc5-4f53-4dca-8819-158442af4b51 tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7.388bea36-15d0-4f18-8080-894ddfa69756 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:22 devstack sudo[102346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7.388bea36-15d0-4f18-8080-894ddfa69756
Nov 19 13:18:22 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:22 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-922ebd20-72dc-470b-a66a-c35008990360" returned: 0 in 0.452s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Lock "cinder-quobyte-922ebd20-72dc-470b-a66a-c35008990360" released by "_copy_volume_from_snapshot" :: held 4.656s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-3c356ee2-74c8-4d33-b04d-889198458d74 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "cinder-bd1d3ee5-3aec-4382-8360-bb46786a3b87-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Lock "cinder-quobyte-1218bea4-e814-42c4-90ea-4932dac27c3e-922ebd20-72dc-470b-a66a-c35008990360" released by "_create_volume_from_snapshot" :: held 4.683s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.719s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-3c356ee2-74c8-4d33-b04d-889198458d74 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "cinder-bd1d3ee5-3aec-4382-8360-bb46786a3b87-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc5505b4-8b9c-43cc-9efd-fb7e18f5778d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-922ebd20-72dc-470b-a66a-c35008990360', 'volume_size': 1, 'snapshot_id': '1218bea4-e814-42c4-90ea-4932dac27c3e'}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a03a00-d43c-40d4-8710-c8731c2a37d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:22 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Volume volume-922ebd20-72dc-470b-a66a-c35008990360 (922ebd20-72dc-470b-a66a-c35008990360): created successfully
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a03a00-d43c-40d4-8710-c8731c2a37d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Flow 'volume_create_manager' (15657e5f-5584-469d-aa2d-12e04b51b7ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-3c356ee2-74c8-4d33-b04d-889198458d74 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "cinder-quobyte-bd1d3ee5-3aec-4382-8360-bb46786a3b87" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:22 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-5f45ad41-33ff-4424-9543-9c9515cbf9fc tempest-SnapshotDependencyTests-73392086 None] Created volume successfully.
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-3c356ee2-74c8-4d33-b04d-889198458d74 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "cinder-quobyte-bd1d3ee5-3aec-4382-8360-bb46786a3b87" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c998c8b-90c2-4da3-8ffe-a4a2e86fb9db]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:22 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3c356ee2-74c8-4d33-b04d-889198458d74 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-bd1d3ee5-3aec-4382-8360-bb46786a3b87 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:23 devstack sudo[102349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-bd1d3ee5-3aec-4382-8360-bb46786a3b87
Nov 19 13:18:23 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:23 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-15de3116-1c5c-4fa2-9a1f-ca33d6add4f1 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.483s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:23 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-15de3116-1c5c-4fa2-9a1f-ca33d6add4f1 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:18:23 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-15de3116-1c5c-4fa2-9a1f-ca33d6add4f1 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Deleted volume successfully.
Nov 19 13:18:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-15de3116-1c5c-4fa2-9a1f-ca33d6add4f1 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "cinder-5509e0d7-5ca9-49cd-a038-018bbe5dff9d-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:23 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-cc6a5dc5-4f53-4dca-8819-158442af4b51 tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7.388bea36-15d0-4f18-8080-894ddfa69756" returned: 0 in 0.502s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-cc6a5dc5-4f53-4dca-8819-158442af4b51 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-quobyte-388bea36-15d0-4f18-8080-894ddfa69756" released by "_delete_snapshot" :: held 2.668s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-cc6a5dc5-4f53-4dca-8819-158442af4b51 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-quobyte-ec4aefec-a859-46cb-a8df-f45b7f630bd7" released by "delete_snapshot" :: held 2.748s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:23 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-cc6a5dc5-4f53-4dca-8819-158442af4b51 tempest-CreateVolumesFromSnapshotTest-287984160 None] Created reservations ['8de8c35f-116e-4c89-bdbe-ee15511d3753', '180f40eb-b84e-4787-b04d-63a2fc97e5bc', '05a96e7f-ac77-47c1-9744-a2401693e2be', '8f1b1e20-d92d-4302-99c1-5cbb03988c59'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:18:23 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-cc6a5dc5-4f53-4dca-8819-158442af4b51 tempest-CreateVolumesFromSnapshotTest-287984160 None] Delete snapshot completed successfully.
Nov 19 13:18:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-cc6a5dc5-4f53-4dca-8819-158442af4b51 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-388bea36-15d0-4f18-8080-894ddfa69756-delete_snapshot" released by "delete_snapshot" :: held 2.829s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:23 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3c356ee2-74c8-4d33-b04d-889198458d74 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-bd1d3ee5-3aec-4382-8360-bb46786a3b87" returned: 0 in 0.581s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3c356ee2-74c8-4d33-b04d-889198458d74 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-bd1d3ee5-3aec-4382-8360-bb46786a3b87 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:23 devstack sudo[102356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-bd1d3ee5-3aec-4382-8360-bb46786a3b87
Nov 19 13:18:23 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b7c0e914-111e-412d-a222-fab66db7f339 tempest-SnapshotDependencyTests-73392086 None] Acquiring lock "cinder-1218bea4-e814-42c4-90ea-4932dac27c3e-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b7c0e914-111e-412d-a222-fab66db7f339 tempest-SnapshotDependencyTests-73392086 None] Lock "cinder-1218bea4-e814-42c4-90ea-4932dac27c3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b7c0e914-111e-412d-a222-fab66db7f339 tempest-SnapshotDependencyTests-73392086 None] Acquiring lock "cinder-quobyte-a1ec2305-6bae-42a7-9220-5547071969cc" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b7c0e914-111e-412d-a222-fab66db7f339 tempest-SnapshotDependencyTests-73392086 None] Lock "cinder-quobyte-a1ec2305-6bae-42a7-9220-5547071969cc" acquired by "delete_snapshot" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b7c0e914-111e-412d-a222-fab66db7f339 tempest-SnapshotDependencyTests-73392086 None] Acquiring lock "cinder-quobyte-1218bea4-e814-42c4-90ea-4932dac27c3e" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b7c0e914-111e-412d-a222-fab66db7f339 tempest-SnapshotDependencyTests-73392086 None] Lock "cinder-quobyte-1218bea4-e814-42c4-90ea-4932dac27c3e" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-b7c0e914-111e-412d-a222-fab66db7f339 tempest-SnapshotDependencyTests-73392086 None] Deleting offline snapshot 1218bea4-e814-42c4-90ea-4932dac27c3e of volume a1ec2305-6bae-42a7-9220-5547071969cc {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 13:18:23 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-b7c0e914-111e-412d-a222-fab66db7f339 tempest-SnapshotDependencyTests-73392086 None] snapshot_file for this snap is: volume-a1ec2305-6bae-42a7-9220-5547071969cc.1218bea4-e814-42c4-90ea-4932dac27c3e {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 13:18:23 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cdbfce-7724-4900-9b7e-98f83ab57e9d]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b7c0e914-111e-412d-a222-fab66db7f339 tempest-SnapshotDependencyTests-73392086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.1218bea4-e814-42c4-90ea-4932dac27c3e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:23 devstack sudo[102358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.1218bea4-e814-42c4-90ea-4932dac27c3e
Nov 19 13:18:23 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c747b4a3-1f48-4f8b-98e9-abb3369f6960 tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "cinder-ec4aefec-a859-46cb-a8df-f45b7f630bd7-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c747b4a3-1f48-4f8b-98e9-abb3369f6960 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-ec4aefec-a859-46cb-a8df-f45b7f630bd7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c747b4a3-1f48-4f8b-98e9-abb3369f6960 tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "cinder-quobyte-ec4aefec-a859-46cb-a8df-f45b7f630bd7" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:23 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c747b4a3-1f48-4f8b-98e9-abb3369f6960 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-quobyte-ec4aefec-a859-46cb-a8df-f45b7f630bd7" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:23 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af66f67-f373-461f-a1bc-3cb8a1b0c48e]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:23 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c747b4a3-1f48-4f8b-98e9-abb3369f6960 tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:23 devstack sudo[102360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7
Nov 19 13:18:23 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:24 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3c356ee2-74c8-4d33-b04d-889198458d74 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-bd1d3ee5-3aec-4382-8360-bb46786a3b87" returned: 0 in 0.508s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-3c356ee2-74c8-4d33-b04d-889198458d74 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "cinder-quobyte-bd1d3ee5-3aec-4382-8360-bb46786a3b87" released by "delete_volume" :: held 1.109s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-3c356ee2-74c8-4d33-b04d-889198458d74 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Created reservations ['bf037846-70bb-492a-b9ef-f440d0e3fa00', 'ab968332-0201-4f34-bc31-1a678cbad10f', '8033d1ee-7829-4444-9e28-e58d76c8f95c', 'd4d9b251-d44d-4ac2-830a-c39de14cefd3'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3c356ee2-74c8-4d33-b04d-889198458d74 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3c356ee2-74c8-4d33-b04d-889198458d74 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3c356ee2-74c8-4d33-b04d-889198458d74 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-3c356ee2-74c8-4d33-b04d-889198458d74 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-3c356ee2-74c8-4d33-b04d-889198458d74 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3c356ee2-74c8-4d33-b04d-889198458d74 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:24 devstack sudo[102364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:18:24 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:24 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b7c0e914-111e-412d-a222-fab66db7f339 tempest-SnapshotDependencyTests-73392086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.1218bea4-e814-42c4-90ea-4932dac27c3e" returned: 0 in 0.608s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-b7c0e914-111e-412d-a222-fab66db7f339 tempest-SnapshotDependencyTests-73392086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1ec2305-6bae-42a7-9220-5547071969cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a55b2fa-e9f5-4e84-a32c-f560912f84b2]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b7c0e914-111e-412d-a222-fab66db7f339 tempest-SnapshotDependencyTests-73392086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:24 devstack sudo[102368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc
Nov 19 13:18:24 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:24 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c747b4a3-1f48-4f8b-98e9-abb3369f6960 tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7" returned: 0 in 0.565s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c747b4a3-1f48-4f8b-98e9-abb3369f6960 tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:24 devstack sudo[102373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7
Nov 19 13:18:24 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:24 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-3c356ee2-74c8-4d33-b04d-889198458d74 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.481s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-3c356ee2-74c8-4d33-b04d-889198458d74 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:18:24 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-3c356ee2-74c8-4d33-b04d-889198458d74 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Deleted volume successfully.
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-3c356ee2-74c8-4d33-b04d-889198458d74 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "cinder-bd1d3ee5-3aec-4382-8360-bb46786a3b87-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:24 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b7c0e914-111e-412d-a222-fab66db7f339 tempest-SnapshotDependencyTests-73392086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc" returned: 0 in 0.571s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b7c0e914-111e-412d-a222-fab66db7f339 tempest-SnapshotDependencyTests-73392086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.1218bea4-e814-42c4-90ea-4932dac27c3e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:24 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:24 devstack sudo[102380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.1218bea4-e814-42c4-90ea-4932dac27c3e
Nov 19 13:18:24 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c747b4a3-1f48-4f8b-98e9-abb3369f6960 tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-ec4aefec-a859-46cb-a8df-f45b7f630bd7" returned: 0 in 0.458s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c747b4a3-1f48-4f8b-98e9-abb3369f6960 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-quobyte-ec4aefec-a859-46cb-a8df-f45b7f630bd7" released by "delete_volume" :: held 1.064s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-c747b4a3-1f48-4f8b-98e9-abb3369f6960 tempest-CreateVolumesFromSnapshotTest-287984160 None] Created reservations ['f814e44f-8538-4051-824e-54310a77167e', 'a47775c6-6efa-44dc-b3b3-c5de8c20f70d', '77a33c00-8db3-4d8f-8db8-6426841b4fc6', '9ec702a1-2053-4600-a77c-132f6eef85cf'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c747b4a3-1f48-4f8b-98e9-abb3369f6960 tempest-CreateVolumesFromSnapshotTest-287984160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c747b4a3-1f48-4f8b-98e9-abb3369f6960 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c747b4a3-1f48-4f8b-98e9-abb3369f6960 tempest-CreateVolumesFromSnapshotTest-287984160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-c747b4a3-1f48-4f8b-98e9-abb3369f6960 tempest-CreateVolumesFromSnapshotTest-287984160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-c747b4a3-1f48-4f8b-98e9-abb3369f6960 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:24 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c747b4a3-1f48-4f8b-98e9-abb3369f6960 tempest-CreateVolumesFromSnapshotTest-287984160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:24 devstack sudo[102382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:18:24 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-49e34723-b8a5-4b91-9669-89a26b8f3dde tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "cinder-1ad96d27-ee16-42a2-be0c-70905625223c-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-49e34723-b8a5-4b91-9669-89a26b8f3dde tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "cinder-1ad96d27-ee16-42a2-be0c-70905625223c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-49e34723-b8a5-4b91-9669-89a26b8f3dde tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "cinder-quobyte-1ad96d27-ee16-42a2-be0c-70905625223c" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-49e34723-b8a5-4b91-9669-89a26b8f3dde tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "cinder-quobyte-1ad96d27-ee16-42a2-be0c-70905625223c" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:25 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad030c09-db8e-42bc-8dde-0ecfad607296]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-49e34723-b8a5-4b91-9669-89a26b8f3dde tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1ad96d27-ee16-42a2-be0c-70905625223c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:25 devstack sudo[102384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1ad96d27-ee16-42a2-be0c-70905625223c
Nov 19 13:18:25 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:25 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b7c0e914-111e-412d-a222-fab66db7f339 tempest-SnapshotDependencyTests-73392086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.1218bea4-e814-42c4-90ea-4932dac27c3e" returned: 0 in 0.522s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b7c0e914-111e-412d-a222-fab66db7f339 tempest-SnapshotDependencyTests-73392086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.1218bea4-e814-42c4-90ea-4932dac27c3e {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:25 devstack sudo[102390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.1218bea4-e814-42c4-90ea-4932dac27c3e
Nov 19 13:18:25 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:25 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-c747b4a3-1f48-4f8b-98e9-abb3369f6960 tempest-CreateVolumesFromSnapshotTest-287984160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.470s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:25 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-c747b4a3-1f48-4f8b-98e9-abb3369f6960 tempest-CreateVolumesFromSnapshotTest-287984160 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:18:25 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-c747b4a3-1f48-4f8b-98e9-abb3369f6960 tempest-CreateVolumesFromSnapshotTest-287984160 None] Deleted volume successfully.
Nov 19 13:18:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-c747b4a3-1f48-4f8b-98e9-abb3369f6960 tempest-CreateVolumesFromSnapshotTest-287984160 None] Lock "cinder-ec4aefec-a859-46cb-a8df-f45b7f630bd7-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:25 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-49e34723-b8a5-4b91-9669-89a26b8f3dde tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1ad96d27-ee16-42a2-be0c-70905625223c" returned: 0 in 0.586s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-49e34723-b8a5-4b91-9669-89a26b8f3dde tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1ad96d27-ee16-42a2-be0c-70905625223c {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:25 devstack sudo[102395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1ad96d27-ee16-42a2-be0c-70905625223c
Nov 19 13:18:25 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:25 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:25 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b7c0e914-111e-412d-a222-fab66db7f339 tempest-SnapshotDependencyTests-73392086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc.1218bea4-e814-42c4-90ea-4932dac27c3e" returned: 0 in 0.460s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b7c0e914-111e-412d-a222-fab66db7f339 tempest-SnapshotDependencyTests-73392086 None] Lock "cinder-quobyte-1218bea4-e814-42c4-90ea-4932dac27c3e" released by "_delete_snapshot" :: held 2.218s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b7c0e914-111e-412d-a222-fab66db7f339 tempest-SnapshotDependencyTests-73392086 None] Lock "cinder-quobyte-a1ec2305-6bae-42a7-9220-5547071969cc" released by "delete_snapshot" :: held 2.234s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:25 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-b7c0e914-111e-412d-a222-fab66db7f339 tempest-SnapshotDependencyTests-73392086 None] Created reservations ['6057e670-37d9-421e-b1e5-293008f103f3', 'c1dd6d08-aa03-4a11-89c3-179b5c7c3c65', '3264495e-0b75-4153-9d85-4f536d94d9c8', '418a8377-ebf0-4a1c-8ed3-caef663c15f9'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:18:25 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-b7c0e914-111e-412d-a222-fab66db7f339 tempest-SnapshotDependencyTests-73392086 None] Delete snapshot completed successfully.
Nov 19 13:18:25 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b7c0e914-111e-412d-a222-fab66db7f339 tempest-SnapshotDependencyTests-73392086 None] Lock "cinder-1218bea4-e814-42c4-90ea-4932dac27c3e-delete_snapshot" released by "delete_snapshot" :: held 2.308s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:26 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-49e34723-b8a5-4b91-9669-89a26b8f3dde tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-1ad96d27-ee16-42a2-be0c-70905625223c" returned: 0 in 0.479s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-49e34723-b8a5-4b91-9669-89a26b8f3dde tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "cinder-quobyte-1ad96d27-ee16-42a2-be0c-70905625223c" released by "delete_volume" :: held 1.085s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:26 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-49e34723-b8a5-4b91-9669-89a26b8f3dde tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Created reservations ['ecf5b175-dc53-437b-a274-0ee51d848d9d', '76453761-1ac0-4d8c-8b21-1049b2ddf33a', 'f3ac1cb8-8eb1-483d-9960-bb646b35b59a', '7c0cf2ed-546b-44c9-a901-e80d729c86bc'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:18:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-49e34723-b8a5-4b91-9669-89a26b8f3dde tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-49e34723-b8a5-4b91-9669-89a26b8f3dde tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-49e34723-b8a5-4b91-9669-89a26b8f3dde tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:26 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-49e34723-b8a5-4b91-9669-89a26b8f3dde tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-49e34723-b8a5-4b91-9669-89a26b8f3dde tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-49e34723-b8a5-4b91-9669-89a26b8f3dde tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:26 devstack sudo[102399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:18:26 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f856642e-9950-4beb-9ad1-a46c9e1f4257 tempest-SnapshotDependencyTests-73392086 None] Acquiring lock "cinder-a1ec2305-6bae-42a7-9220-5547071969cc-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f856642e-9950-4beb-9ad1-a46c9e1f4257 tempest-SnapshotDependencyTests-73392086 None] Lock "cinder-a1ec2305-6bae-42a7-9220-5547071969cc-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:26 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-49e34723-b8a5-4b91-9669-89a26b8f3dde tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.556s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:26 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-49e34723-b8a5-4b91-9669-89a26b8f3dde tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:18:26 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-49e34723-b8a5-4b91-9669-89a26b8f3dde tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Deleted volume successfully.
Nov 19 13:18:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f856642e-9950-4beb-9ad1-a46c9e1f4257 tempest-SnapshotDependencyTests-73392086 None] Acquiring lock "cinder-quobyte-a1ec2305-6bae-42a7-9220-5547071969cc" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-49e34723-b8a5-4b91-9669-89a26b8f3dde tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "cinder-1ad96d27-ee16-42a2-be0c-70905625223c-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:26 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f856642e-9950-4beb-9ad1-a46c9e1f4257 tempest-SnapshotDependencyTests-73392086 None] Lock "cinder-quobyte-a1ec2305-6bae-42a7-9220-5547071969cc" acquired by "delete_volume" :: waited 0.012s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:26 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5f806d-d376-4865-9a70-c6e66571e3dc]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:26 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f856642e-9950-4beb-9ad1-a46c9e1f4257 tempest-SnapshotDependencyTests-73392086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:26 devstack sudo[102402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc
Nov 19 13:18:26 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-fced5754-ec2e-4bfb-8cc2-5dc4b147dd87 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "cinder-a55c0daf-d2bb-45f7-addd-fc24c4f7aa39-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-fced5754-ec2e-4bfb-8cc2-5dc4b147dd87 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "cinder-a55c0daf-d2bb-45f7-addd-fc24c4f7aa39-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-fced5754-ec2e-4bfb-8cc2-5dc4b147dd87 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "cinder-quobyte-a55c0daf-d2bb-45f7-addd-fc24c4f7aa39" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-fced5754-ec2e-4bfb-8cc2-5dc4b147dd87 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "cinder-quobyte-a55c0daf-d2bb-45f7-addd-fc24c4f7aa39" acquired by "delete_volume" :: waited 0.006s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1305920b-1da2-446d-9726-782e36a75e71]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fced5754-ec2e-4bfb-8cc2-5dc4b147dd87 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a55c0daf-d2bb-45f7-addd-fc24c4f7aa39 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:27 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f856642e-9950-4beb-9ad1-a46c9e1f4257 tempest-SnapshotDependencyTests-73392086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc" returned: 0 in 0.585s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f856642e-9950-4beb-9ad1-a46c9e1f4257 tempest-SnapshotDependencyTests-73392086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:27 devstack sudo[102404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a55c0daf-d2bb-45f7-addd-fc24c4f7aa39
Nov 19 13:18:27 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:27 devstack sudo[102408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc
Nov 19 13:18:27 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Flow 'volume_create_manager' (4497b74b-6389-41dc-b706-eba59c4c01bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9234fef3-a555-4396-bd2d-4d7a33b338f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9234fef3-a555-4396-bd2d-4d7a33b338f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=746f0354-1bc6-488a-b055-2196f175208b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9834ad834c9b4e119ded3c17992ead02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:18:28Z,use_quota=True,user_id='e08eef323030473b8548416507c97382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c11868-cbf7-4251-91a4-5a4bb2c2aadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c11868-cbf7-4251-91a4-5a4bb2c2aadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97297648-7427-4474-94eb-e19ebe2412a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97297648-7427-4474-94eb-e19ebe2412a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '746f0354-1bc6-488a-b055-2196f175208b', 'volume_name': 'volume-746f0354-1bc6-488a-b055-2196f175208b', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a6ab10-ac6e-4099-9e97-029ee72881ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a6ab10-ac6e-4099-9e97-029ee72881ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f241d166-4c4c-4433-b6ea-5519ad1d1fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:27 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Volume 746f0354-1bc6-488a-b055-2196f175208b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-746f0354-1bc6-488a-b055-2196f175208b', 'volume_size': 1}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=746f0354-1bc6-488a-b055-2196f175208b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9834ad834c9b4e119ded3c17992ead02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:18:28Z,use_quota=True,user_id='e08eef323030473b8548416507c97382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Creating volume 746f0354-1bc6-488a-b055-2196f175208b {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:18:27 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-746f0354-1bc6-488a-b055-2196f175208b 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:27 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:27 devstack sudo[102415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-746f0354-1bc6-488a-b055-2196f175208b 1073741824
Nov 19 13:18:27 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f856642e-9950-4beb-9ad1-a46c9e1f4257 tempest-SnapshotDependencyTests-73392086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a1ec2305-6bae-42a7-9220-5547071969cc" returned: 0 in 0.470s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f856642e-9950-4beb-9ad1-a46c9e1f4257 tempest-SnapshotDependencyTests-73392086 None] Lock "cinder-quobyte-a1ec2305-6bae-42a7-9220-5547071969cc" released by "delete_volume" :: held 1.091s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-f856642e-9950-4beb-9ad1-a46c9e1f4257 tempest-SnapshotDependencyTests-73392086 None] Created reservations ['6b43d42c-137f-4844-a56a-7227d986ebb5', '9fca86aa-0557-45dc-b564-a6a93f9e5ad9', 'f1fb727c-f223-42e9-ae37-b67c4b9d7892', 'dfcbd460-a675-49ee-94d5-c9334a7cecfe'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f856642e-9950-4beb-9ad1-a46c9e1f4257 tempest-SnapshotDependencyTests-73392086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f856642e-9950-4beb-9ad1-a46c9e1f4257 tempest-SnapshotDependencyTests-73392086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-f856642e-9950-4beb-9ad1-a46c9e1f4257 tempest-SnapshotDependencyTests-73392086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-f856642e-9950-4beb-9ad1-a46c9e1f4257 tempest-SnapshotDependencyTests-73392086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-f856642e-9950-4beb-9ad1-a46c9e1f4257 tempest-SnapshotDependencyTests-73392086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f856642e-9950-4beb-9ad1-a46c9e1f4257 tempest-SnapshotDependencyTests-73392086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:27 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fced5754-ec2e-4bfb-8cc2-5dc4b147dd87 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a55c0daf-d2bb-45f7-addd-fc24c4f7aa39" returned: 0 in 0.696s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:27 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fced5754-ec2e-4bfb-8cc2-5dc4b147dd87 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a55c0daf-d2bb-45f7-addd-fc24c4f7aa39 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:27 devstack sudo[102417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:18:27 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:27 devstack sudo[102418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a55c0daf-d2bb-45f7-addd-fc24c4f7aa39
Nov 19 13:18:27 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:28 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-746f0354-1bc6-488a-b055-2196f175208b 1073741824" returned: 0 in 0.555s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-746f0354-1bc6-488a-b055-2196f175208b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:28 devstack sudo[102426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-746f0354-1bc6-488a-b055-2196f175208b
Nov 19 13:18:28 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:28 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fced5754-ec2e-4bfb-8cc2-5dc4b147dd87 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-a55c0daf-d2bb-45f7-addd-fc24c4f7aa39" returned: 0 in 0.485s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-fced5754-ec2e-4bfb-8cc2-5dc4b147dd87 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "cinder-quobyte-a55c0daf-d2bb-45f7-addd-fc24c4f7aa39" released by "delete_volume" :: held 1.205s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:28 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-f856642e-9950-4beb-9ad1-a46c9e1f4257 tempest-SnapshotDependencyTests-73392086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.513s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-f856642e-9950-4beb-9ad1-a46c9e1f4257 tempest-SnapshotDependencyTests-73392086 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:18:28 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-f856642e-9950-4beb-9ad1-a46c9e1f4257 tempest-SnapshotDependencyTests-73392086 None] Deleted volume successfully.
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-f856642e-9950-4beb-9ad1-a46c9e1f4257 tempest-SnapshotDependencyTests-73392086 None] Lock "cinder-a1ec2305-6bae-42a7-9220-5547071969cc-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-fced5754-ec2e-4bfb-8cc2-5dc4b147dd87 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Created reservations ['b761c4ec-ab1f-4ca4-a5ab-4a4647a64b1f', 'f2b884b5-fe6d-43f7-90f9-e46542b14ae2', 'f362cbdd-23fa-4b91-9781-d36438b6a34e', '57ce4105-75ca-444e-91e0-a5c66687b7c8'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-fced5754-ec2e-4bfb-8cc2-5dc4b147dd87 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-fced5754-ec2e-4bfb-8cc2-5dc4b147dd87 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-fced5754-ec2e-4bfb-8cc2-5dc4b147dd87 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-fced5754-ec2e-4bfb-8cc2-5dc4b147dd87 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-fced5754-ec2e-4bfb-8cc2-5dc4b147dd87 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fced5754-ec2e-4bfb-8cc2-5dc4b147dd87 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:28 devstack sudo[102428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:18:28 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:28 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-746f0354-1bc6-488a-b055-2196f175208b" returned: 0 in 0.469s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f241d166-4c4c-4433-b6ea-5519ad1d1fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-746f0354-1bc6-488a-b055-2196f175208b', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf5d7b16-1e7e-4ad3-8986-641f4e842d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b30d92cb-7ffb-42a6-8db3-bfd1e3350445 tempest-SnapshotDependencyTests-73392086 None] Acquiring lock "cinder-922ebd20-72dc-470b-a66a-c35008990360-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:28 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Volume volume-746f0354-1bc6-488a-b055-2196f175208b (746f0354-1bc6-488a-b055-2196f175208b): created successfully
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf5d7b16-1e7e-4ad3-8986-641f4e842d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Flow 'volume_create_manager' (4497b74b-6389-41dc-b706-eba59c4c01bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b30d92cb-7ffb-42a6-8db3-bfd1e3350445 tempest-SnapshotDependencyTests-73392086 None] Lock "cinder-922ebd20-72dc-470b-a66a-c35008990360-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:28 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:28 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-6e444cff-4107-4aad-a645-770ea71afb8c tempest-CinderUnicodeTest-2009313857 None] Created volume successfully.
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-fced5754-ec2e-4bfb-8cc2-5dc4b147dd87 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.436s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-fced5754-ec2e-4bfb-8cc2-5dc4b147dd87 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:18:28 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-fced5754-ec2e-4bfb-8cc2-5dc4b147dd87 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Deleted volume successfully.
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b30d92cb-7ffb-42a6-8db3-bfd1e3350445 tempest-SnapshotDependencyTests-73392086 None] Acquiring lock "cinder-quobyte-922ebd20-72dc-470b-a66a-c35008990360" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-fced5754-ec2e-4bfb-8cc2-5dc4b147dd87 tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "cinder-a55c0daf-d2bb-45f7-addd-fc24c4f7aa39-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:28 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b30d92cb-7ffb-42a6-8db3-bfd1e3350445 tempest-SnapshotDependencyTests-73392086 None] Lock "cinder-quobyte-922ebd20-72dc-470b-a66a-c35008990360" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:29 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[662bc046-0ed9-4163-b000-3a03532a60f9]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b30d92cb-7ffb-42a6-8db3-bfd1e3350445 tempest-SnapshotDependencyTests-73392086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-922ebd20-72dc-470b-a66a-c35008990360 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:29 devstack sudo[102432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-922ebd20-72dc-470b-a66a-c35008990360
Nov 19 13:18:29 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:29 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0fab370d-80a1-4db6-bb62-ab67708ef94e tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "cinder-0562aaca-1381-470d-8b29-a7262291ae49-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:29 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0fab370d-80a1-4db6-bb62-ab67708ef94e tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "cinder-0562aaca-1381-470d-8b29-a7262291ae49-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:29 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0fab370d-80a1-4db6-bb62-ab67708ef94e tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "cinder-quobyte-0562aaca-1381-470d-8b29-a7262291ae49" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:29 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0fab370d-80a1-4db6-bb62-ab67708ef94e tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "cinder-quobyte-0562aaca-1381-470d-8b29-a7262291ae49" acquired by "delete_volume" :: waited 0.008s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:29 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9020a48-6477-4e90-a95d-2460ca9da692]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0fab370d-80a1-4db6-bb62-ab67708ef94e tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0562aaca-1381-470d-8b29-a7262291ae49 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:29 devstack sudo[102434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0562aaca-1381-470d-8b29-a7262291ae49
Nov 19 13:18:29 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:29 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b30d92cb-7ffb-42a6-8db3-bfd1e3350445 tempest-SnapshotDependencyTests-73392086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-922ebd20-72dc-470b-a66a-c35008990360" returned: 0 in 0.549s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b30d92cb-7ffb-42a6-8db3-bfd1e3350445 tempest-SnapshotDependencyTests-73392086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-922ebd20-72dc-470b-a66a-c35008990360 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:29 devstack sudo[102439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-922ebd20-72dc-470b-a66a-c35008990360
Nov 19 13:18:29 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:29 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0fab370d-80a1-4db6-bb62-ab67708ef94e tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0562aaca-1381-470d-8b29-a7262291ae49" returned: 0 in 0.556s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:29 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0fab370d-80a1-4db6-bb62-ab67708ef94e tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0562aaca-1381-470d-8b29-a7262291ae49 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:29 devstack sudo[102445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0562aaca-1381-470d-8b29-a7262291ae49
Nov 19 13:18:30 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:30 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b30d92cb-7ffb-42a6-8db3-bfd1e3350445 tempest-SnapshotDependencyTests-73392086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-922ebd20-72dc-470b-a66a-c35008990360" returned: 0 in 0.513s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b30d92cb-7ffb-42a6-8db3-bfd1e3350445 tempest-SnapshotDependencyTests-73392086 None] Lock "cinder-quobyte-922ebd20-72dc-470b-a66a-c35008990360" released by "delete_volume" :: held 1.086s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-b30d92cb-7ffb-42a6-8db3-bfd1e3350445 tempest-SnapshotDependencyTests-73392086 None] Created reservations ['cc544d46-ed31-4bc1-8841-a62c0637fcde', '21225b44-c45c-456a-9ae8-92eb517be1fd', 'e1fae473-bca4-447b-bef3-5d5bcc66d45b', 'e46863f3-bdb8-4cca-a184-24317bd85428'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG cinder.volume.flows.manager.create_volume [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=80839) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Flow 'volume_create_manager' (c463ed10-5630-4b3c-9902-b18e5ced10e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d80dd0e5-0149-4cef-a85a-e7363c852de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d80dd0e5-0149-4cef-a85a-e7363c852de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:18:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2104182293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ab1964-023d-430e-ba91-36b5da626470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9834ad834c9b4e119ded3c17992ead02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:18:30Z,use_quota=True,user_id='e08eef323030473b8548416507c97382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e5270fb-855f-4f74-bd20-a35a230c6fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e5270fb-855f-4f74-bd20-a35a230c6fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1839c6ed-f8e4-478d-ba5b-db9feadbef12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1839c6ed-f8e4-478d-ba5b-db9feadbef12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31ab1964-023d-430e-ba91-36b5da626470', 'volume_name': 'volume-31ab1964-023d-430e-ba91-36b5da626470', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b167ab09-4bbf-4151-a00e-12f8368d440a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b167ab09-4bbf-4151-a00e-12f8368d440a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41d731d8-826e-4e12-8e04-36b9d27df15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:30 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Volume 31ab1964-023d-430e-ba91-36b5da626470: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31ab1964-023d-430e-ba91-36b5da626470', 'volume_size': 1}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fbd1ea53f10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-11-19T12:18:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2104182293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ab1964-023d-430e-ba91-36b5da626470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9834ad834c9b4e119ded3c17992ead02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-11-19T12:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-11-19T12:18:30Z,use_quota=True,user_id='e08eef323030473b8548416507c97382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27e88f40-f7d6-452f-b45a-ffafbaf462d3),volume_type_id=27e88f40-f7d6-452f-b45a-ffafbaf462d3)}" {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Creating volume 31ab1964-023d-430e-ba91-36b5da626470 {{(pid=80839) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Selected osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0 as target Quobyte volume. {{(pid=80839) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:652}}
Nov 19 13:18:30 devstack cinder-volume[80839]: INFO cinder.volume.drivers.remotefs [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] casted to osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470 1073741824 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:30 devstack sudo[102447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470 1073741824
Nov 19 13:18:30 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b30d92cb-7ffb-42a6-8db3-bfd1e3350445 tempest-SnapshotDependencyTests-73392086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b30d92cb-7ffb-42a6-8db3-bfd1e3350445 tempest-SnapshotDependencyTests-73392086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b30d92cb-7ffb-42a6-8db3-bfd1e3350445 tempest-SnapshotDependencyTests-73392086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-b30d92cb-7ffb-42a6-8db3-bfd1e3350445 tempest-SnapshotDependencyTests-73392086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-b30d92cb-7ffb-42a6-8db3-bfd1e3350445 tempest-SnapshotDependencyTests-73392086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b30d92cb-7ffb-42a6-8db3-bfd1e3350445 tempest-SnapshotDependencyTests-73392086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:30 devstack sudo[102449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:18:30 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:30 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0fab370d-80a1-4db6-bb62-ab67708ef94e tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-0562aaca-1381-470d-8b29-a7262291ae49" returned: 0 in 0.510s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0fab370d-80a1-4db6-bb62-ab67708ef94e tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "cinder-quobyte-0562aaca-1381-470d-8b29-a7262291ae49" released by "delete_volume" :: held 1.089s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-0fab370d-80a1-4db6-bb62-ab67708ef94e tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Created reservations ['06b6881b-5c0c-454c-89e3-56acb6e0dcc9', '1f304c02-bb54-41aa-8473-530f0ade0e06', '1f4f6f8c-92c1-4975-b4bc-184941960403', 'c91d2d04-d203-4cc2-a2c6-7babe28813a6'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0fab370d-80a1-4db6-bb62-ab67708ef94e tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0fab370d-80a1-4db6-bb62-ab67708ef94e tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0fab370d-80a1-4db6-bb62-ab67708ef94e tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-0fab370d-80a1-4db6-bb62-ab67708ef94e tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-0fab370d-80a1-4db6-bb62-ab67708ef94e tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0fab370d-80a1-4db6-bb62-ab67708ef94e tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:30 devstack sudo[102452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:18:30 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:30 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-b30d92cb-7ffb-42a6-8db3-bfd1e3350445 tempest-SnapshotDependencyTests-73392086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.457s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-b30d92cb-7ffb-42a6-8db3-bfd1e3350445 tempest-SnapshotDependencyTests-73392086 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:18:30 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-b30d92cb-7ffb-42a6-8db3-bfd1e3350445 tempest-SnapshotDependencyTests-73392086 None] Deleted volume successfully.
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-b30d92cb-7ffb-42a6-8db3-bfd1e3350445 tempest-SnapshotDependencyTests-73392086 None] Lock "cinder-922ebd20-72dc-470b-a66a-c35008990360-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:30 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470 1073741824" returned: 0 in 0.545s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:30 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:30 devstack sudo[102458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470
Nov 19 13:18:30 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:31 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-0fab370d-80a1-4db6-bb62-ab67708ef94e tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.447s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:31 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-0fab370d-80a1-4db6-bb62-ab67708ef94e tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:18:31 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-0fab370d-80a1-4db6-bb62-ab67708ef94e tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Deleted volume successfully.
Nov 19 13:18:31 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-0fab370d-80a1-4db6-bb62-ab67708ef94e tempest-CreateVolumesFromSourceVolumeTest-2071495247 None] Lock "cinder-0562aaca-1381-470d-8b29-a7262291ae49-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:31 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470" returned: 0 in 0.457s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:31 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'} {{(pid=80839) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Nov 19 13:18:31 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41d731d8-826e-4e12-8e04-36b9d27df15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31ab1964-023d-430e-ba91-36b5da626470', 'volume_size': 1}' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f938e6-9208-4da1-a8c3-afbcfeecddb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Nov 19 13:18:31 devstack cinder-volume[80839]: INFO cinder.volume.flows.manager.create_volume [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Volume volume-31ab1964-023d-430e-ba91-36b5da626470 (31ab1964-023d-430e-ba91-36b5da626470): created successfully
Nov 19 13:18:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f938e6-9208-4da1-a8c3-afbcfeecddb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=80839) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Nov 19 13:18:31 devstack cinder-volume[80839]: DEBUG cinder.volume.manager [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Flow 'volume_create_manager' (c463ed10-5630-4b3c-9902-b18e5ced10e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=80839) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Nov 19 13:18:31 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-a899fed0-621b-4f25-9c36-2d5dbd322efc tempest-CinderUnicodeTest-2009313857 None] Created volume successfully.
Nov 19 13:18:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ff90ecfb-9a10-4408-ad40-70b15c698256 tempest-CinderUnicodeTest-2009313857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ff90ecfb-9a10-4408-ad40-70b15c698256 tempest-CinderUnicodeTest-2009313857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:32 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-ff90ecfb-9a10-4408-ad40-70b15c698256 tempest-CinderUnicodeTest-2009313857 None] Creating offline snapshot 13e1ba11-bf3a-4a75-bc1a-054b1b535c5b of volume 31ab1964-023d-430e-ba91-36b5da626470 {{(pid=80839) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Nov 19 13:18:32 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[474622a9-5225-486b-8d30-f579696c0758]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:32 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ff90ecfb-9a10-4408-ad40-70b15c698256 tempest-CinderUnicodeTest-2009313857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:32 devstack sudo[102463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470
Nov 19 13:18:32 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:33 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ff90ecfb-9a10-4408-ad40-70b15c698256 tempest-CinderUnicodeTest-2009313857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470" returned: 0 in 0.570s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ff90ecfb-9a10-4408-ad40-70b15c698256 tempest-CinderUnicodeTest-2009313857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470.13e1ba11-bf3a-4a75-bc1a-054b1b535c5b 1G {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:33 devstack sudo[102469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470.13e1ba11-bf3a-4a75-bc1a-054b1b535c5b 1G
Nov 19 13:18:33 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:33 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ff90ecfb-9a10-4408-ad40-70b15c698256 tempest-CinderUnicodeTest-2009313857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470.13e1ba11-bf3a-4a75-bc1a-054b1b535c5b 1G" returned: 0 in 0.606s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:33 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ff90ecfb-9a10-4408-ad40-70b15c698256 tempest-CinderUnicodeTest-2009313857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31ab1964-023d-430e-ba91-36b5da626470 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470.13e1ba11-bf3a-4a75-bc1a-054b1b535c5b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:33 devstack sudo[102475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31ab1964-023d-430e-ba91-36b5da626470 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470.13e1ba11-bf3a-4a75-bc1a-054b1b535c5b
Nov 19 13:18:33 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:34 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ff90ecfb-9a10-4408-ad40-70b15c698256 tempest-CinderUnicodeTest-2009313857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31ab1964-023d-430e-ba91-36b5da626470 -F qcow2 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470.13e1ba11-bf3a-4a75-bc1a-054b1b535c5b" returned: 0 in 0.481s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:34 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-ff90ecfb-9a10-4408-ad40-70b15c698256 tempest-CinderUnicodeTest-2009313857 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470.13e1ba11-bf3a-4a75-bc1a-054b1b535c5b is being set with open permissions: ugo+rw
Nov 19 13:18:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ff90ecfb-9a10-4408-ad40-70b15c698256 tempest-CinderUnicodeTest-2009313857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470.13e1ba11-bf3a-4a75-bc1a-054b1b535c5b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:34 devstack sudo[102480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470.13e1ba11-bf3a-4a75-bc1a-054b1b535c5b
Nov 19 13:18:34 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:34 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ff90ecfb-9a10-4408-ad40-70b15c698256 tempest-CinderUnicodeTest-2009313857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470.13e1ba11-bf3a-4a75-bc1a-054b1b535c5b" returned: 0 in 0.424s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:34 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ff90ecfb-9a10-4408-ad40-70b15c698256 tempest-CinderUnicodeTest-2009313857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:34 devstack sudo[102483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470.info
Nov 19 13:18:34 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:35 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ff90ecfb-9a10-4408-ad40-70b15c698256 tempest-CinderUnicodeTest-2009313857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470.info" returned: 0 in 0.476s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:35 devstack cinder-volume[80839]: WARNING cinder.volume.drivers.remotefs [None req-ff90ecfb-9a10-4408-ad40-70b15c698256 tempest-CinderUnicodeTest-2009313857 None] /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470.info is being set with open permissions: ugo+rw
Nov 19 13:18:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ff90ecfb-9a10-4408-ad40-70b15c698256 tempest-CinderUnicodeTest-2009313857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470.info {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:35 devstack sudo[102487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470.info
Nov 19 13:18:35 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:35 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-ff90ecfb-9a10-4408-ad40-70b15c698256 tempest-CinderUnicodeTest-2009313857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470.info" returned: 0 in 0.511s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:35 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-ff90ecfb-9a10-4408-ad40-70b15c698256 tempest-CinderUnicodeTest-2009313857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.129s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:35 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-ff90ecfb-9a10-4408-ad40-70b15c698256 tempest-CinderUnicodeTest-2009313857 None] Create snapshot completed successfully
Nov 19 13:18:36 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d645ab81-ad92-4938-b9f4-f0952ccabb9d tempest-CinderUnicodeTest-2009313857 None] Acquiring lock "cinder-13e1ba11-bf3a-4a75-bc1a-054b1b535c5b-delete_snapshot" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:36 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d645ab81-ad92-4938-b9f4-f0952ccabb9d tempest-CinderUnicodeTest-2009313857 None] Lock "cinder-13e1ba11-bf3a-4a75-bc1a-054b1b535c5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:36 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d645ab81-ad92-4938-b9f4-f0952ccabb9d tempest-CinderUnicodeTest-2009313857 None] Acquiring lock "cinder-quobyte-31ab1964-023d-430e-ba91-36b5da626470" by "delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:36 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d645ab81-ad92-4938-b9f4-f0952ccabb9d tempest-CinderUnicodeTest-2009313857 None] Lock "cinder-quobyte-31ab1964-023d-430e-ba91-36b5da626470" acquired by "delete_snapshot" :: waited 0.010s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:36 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d645ab81-ad92-4938-b9f4-f0952ccabb9d tempest-CinderUnicodeTest-2009313857 None] Acquiring lock "cinder-quobyte-13e1ba11-bf3a-4a75-bc1a-054b1b535c5b" by "_delete_snapshot" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:36 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d645ab81-ad92-4938-b9f4-f0952ccabb9d tempest-CinderUnicodeTest-2009313857 None] Lock "cinder-quobyte-13e1ba11-bf3a-4a75-bc1a-054b1b535c5b" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:36 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-d645ab81-ad92-4938-b9f4-f0952ccabb9d tempest-CinderUnicodeTest-2009313857 None] Deleting offline snapshot 13e1ba11-bf3a-4a75-bc1a-054b1b535c5b of volume 31ab1964-023d-430e-ba91-36b5da626470 {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Nov 19 13:18:36 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-d645ab81-ad92-4938-b9f4-f0952ccabb9d tempest-CinderUnicodeTest-2009313857 None] snapshot_file for this snap is: volume-31ab1964-023d-430e-ba91-36b5da626470.13e1ba11-bf3a-4a75-bc1a-054b1b535c5b {{(pid=80839) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Nov 19 13:18:36 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb43f4b7-3b75-4160-8626-44ba5ac9a0aa]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:36 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d645ab81-ad92-4938-b9f4-f0952ccabb9d tempest-CinderUnicodeTest-2009313857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470.13e1ba11-bf3a-4a75-bc1a-054b1b535c5b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:36 devstack sudo[102497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470.13e1ba11-bf3a-4a75-bc1a-054b1b535c5b
Nov 19 13:18:36 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:37 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d645ab81-ad92-4938-b9f4-f0952ccabb9d tempest-CinderUnicodeTest-2009313857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470.13e1ba11-bf3a-4a75-bc1a-054b1b535c5b" returned: 0 in 0.585s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:37 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.remotefs [None req-d645ab81-ad92-4938-b9f4-f0952ccabb9d tempest-CinderUnicodeTest-2009313857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31ab1964-023d-430e-ba91-36b5da626470(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=80839) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Nov 19 13:18:37 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4138ded8-f31d-4b52-b962-9c1a4fe7e465]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d645ab81-ad92-4938-b9f4-f0952ccabb9d tempest-CinderUnicodeTest-2009313857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:37 devstack sudo[102502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470
Nov 19 13:18:37 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:37 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d645ab81-ad92-4938-b9f4-f0952ccabb9d tempest-CinderUnicodeTest-2009313857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470" returned: 0 in 0.541s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:37 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d645ab81-ad92-4938-b9f4-f0952ccabb9d tempest-CinderUnicodeTest-2009313857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470.13e1ba11-bf3a-4a75-bc1a-054b1b535c5b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:37 devstack sudo[102541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470.13e1ba11-bf3a-4a75-bc1a-054b1b535c5b
Nov 19 13:18:37 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:38 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d645ab81-ad92-4938-b9f4-f0952ccabb9d tempest-CinderUnicodeTest-2009313857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470.13e1ba11-bf3a-4a75-bc1a-054b1b535c5b" returned: 0 in 0.446s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d645ab81-ad92-4938-b9f4-f0952ccabb9d tempest-CinderUnicodeTest-2009313857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470.13e1ba11-bf3a-4a75-bc1a-054b1b535c5b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:38 devstack sudo[102546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470.13e1ba11-bf3a-4a75-bc1a-054b1b535c5b
Nov 19 13:18:38 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:38 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:38 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-d645ab81-ad92-4938-b9f4-f0952ccabb9d tempest-CinderUnicodeTest-2009313857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470.13e1ba11-bf3a-4a75-bc1a-054b1b535c5b" returned: 0 in 0.426s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:38 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d645ab81-ad92-4938-b9f4-f0952ccabb9d tempest-CinderUnicodeTest-2009313857 None] Lock "cinder-quobyte-13e1ba11-bf3a-4a75-bc1a-054b1b535c5b" released by "_delete_snapshot" :: held 2.066s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:38 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d645ab81-ad92-4938-b9f4-f0952ccabb9d tempest-CinderUnicodeTest-2009313857 None] Lock "cinder-quobyte-31ab1964-023d-430e-ba91-36b5da626470" released by "delete_snapshot" :: held 2.079s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:38 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-d645ab81-ad92-4938-b9f4-f0952ccabb9d tempest-CinderUnicodeTest-2009313857 None] Created reservations ['678cc8be-e060-4b62-baba-19d8df90180b', '470c1e1a-8d10-4c9a-842d-b0e45ad1b378', '474cd805-3a09-46de-98d2-74d47255cf9c', '2a6d4988-03d3-468f-bd8d-092bf55718e5'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:18:38 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-d645ab81-ad92-4938-b9f4-f0952ccabb9d tempest-CinderUnicodeTest-2009313857 None] Delete snapshot completed successfully.
Nov 19 13:18:38 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-d645ab81-ad92-4938-b9f4-f0952ccabb9d tempest-CinderUnicodeTest-2009313857 None] Lock "cinder-13e1ba11-bf3a-4a75-bc1a-054b1b535c5b-delete_snapshot" released by "delete_snapshot" :: held 2.160s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:39 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-1b56d578-b9da-40c3-965c-dace4ed3a021 tempest-CinderUnicodeTest-2009313857 None] Acquiring lock "cinder-31ab1964-023d-430e-ba91-36b5da626470-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:39 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-1b56d578-b9da-40c3-965c-dace4ed3a021 tempest-CinderUnicodeTest-2009313857 None] Lock "cinder-31ab1964-023d-430e-ba91-36b5da626470-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:39 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-1b56d578-b9da-40c3-965c-dace4ed3a021 tempest-CinderUnicodeTest-2009313857 None] Acquiring lock "cinder-quobyte-31ab1964-023d-430e-ba91-36b5da626470" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:39 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-1b56d578-b9da-40c3-965c-dace4ed3a021 tempest-CinderUnicodeTest-2009313857 None] Lock "cinder-quobyte-31ab1964-023d-430e-ba91-36b5da626470" acquired by "delete_volume" :: waited 0.011s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:39 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e932506-6950-4944-97dc-0df3a2d73f57]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:39 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1b56d578-b9da-40c3-965c-dace4ed3a021 tempest-CinderUnicodeTest-2009313857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:39 devstack sudo[102549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470
Nov 19 13:18:39 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:40 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1b56d578-b9da-40c3-965c-dace4ed3a021 tempest-CinderUnicodeTest-2009313857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470" returned: 0 in 0.513s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1b56d578-b9da-40c3-965c-dace4ed3a021 tempest-CinderUnicodeTest-2009313857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:40 devstack sudo[102554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470
Nov 19 13:18:40 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:40 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1b56d578-b9da-40c3-965c-dace4ed3a021 tempest-CinderUnicodeTest-2009313857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-31ab1964-023d-430e-ba91-36b5da626470" returned: 0 in 0.425s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:40 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-1b56d578-b9da-40c3-965c-dace4ed3a021 tempest-CinderUnicodeTest-2009313857 None] Lock "cinder-quobyte-31ab1964-023d-430e-ba91-36b5da626470" released by "delete_volume" :: held 0.970s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:40 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-1b56d578-b9da-40c3-965c-dace4ed3a021 tempest-CinderUnicodeTest-2009313857 None] Created reservations ['4780b276-89d8-4297-a363-246e78004bb6', '8ce0e3ee-dfce-48ef-8f00-ceae75f70a01', 'a2a49c17-0858-48d3-b1ab-5b3d2e61f5d1', 'd1b67cb7-ad52-4105-bfeb-7993709a7bca'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:18:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1b56d578-b9da-40c3-965c-dace4ed3a021 tempest-CinderUnicodeTest-2009313857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1b56d578-b9da-40c3-965c-dace4ed3a021 tempest-CinderUnicodeTest-2009313857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:40 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1b56d578-b9da-40c3-965c-dace4ed3a021 tempest-CinderUnicodeTest-2009313857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:40 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-1b56d578-b9da-40c3-965c-dace4ed3a021 tempest-CinderUnicodeTest-2009313857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-1b56d578-b9da-40c3-965c-dace4ed3a021 tempest-CinderUnicodeTest-2009313857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1b56d578-b9da-40c3-965c-dace4ed3a021 tempest-CinderUnicodeTest-2009313857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:40 devstack sudo[102557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:18:40 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:40 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8bfccc9f-34f6-4a5b-a161-63af77e40cc7 tempest-CinderUnicodeTest-2009313857 None] Acquiring lock "cinder-746f0354-1bc6-488a-b055-2196f175208b-delete_volume" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:40 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8bfccc9f-34f6-4a5b-a161-63af77e40cc7 tempest-CinderUnicodeTest-2009313857 None] Lock "cinder-746f0354-1bc6-488a-b055-2196f175208b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:40 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8bfccc9f-34f6-4a5b-a161-63af77e40cc7 tempest-CinderUnicodeTest-2009313857 None] Acquiring lock "cinder-quobyte-746f0354-1bc6-488a-b055-2196f175208b" by "delete_volume" {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Nov 19 13:18:40 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8bfccc9f-34f6-4a5b-a161-63af77e40cc7 tempest-CinderUnicodeTest-2009313857 None] Lock "cinder-quobyte-746f0354-1bc6-488a-b055-2196f175208b" acquired by "delete_volume" :: waited 0.009s {{(pid=80839) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Nov 19 13:18:40 devstack cinder-volume[80839]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ff9d54-08cb-484e-be7a-58897f91eef8]: (4, 'qcow2') {{(pid=81550) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Nov 19 13:18:40 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8bfccc9f-34f6-4a5b-a161-63af77e40cc7 tempest-CinderUnicodeTest-2009313857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-746f0354-1bc6-488a-b055-2196f175208b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:41 devstack sudo[102559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-746f0354-1bc6-488a-b055-2196f175208b
Nov 19 13:18:41 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:41 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-1b56d578-b9da-40c3-965c-dace4ed3a021 tempest-CinderUnicodeTest-2009313857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.450s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:41 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-1b56d578-b9da-40c3-965c-dace4ed3a021 tempest-CinderUnicodeTest-2009313857 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:18:41 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-1b56d578-b9da-40c3-965c-dace4ed3a021 tempest-CinderUnicodeTest-2009313857 None] Deleted volume successfully.
Nov 19 13:18:41 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-1b56d578-b9da-40c3-965c-dace4ed3a021 tempest-CinderUnicodeTest-2009313857 None] Lock "cinder-31ab1964-023d-430e-ba91-36b5da626470-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:41 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8bfccc9f-34f6-4a5b-a161-63af77e40cc7 tempest-CinderUnicodeTest-2009313857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-746f0354-1bc6-488a-b055-2196f175208b" returned: 0 in 0.531s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8bfccc9f-34f6-4a5b-a161-63af77e40cc7 tempest-CinderUnicodeTest-2009313857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-746f0354-1bc6-488a-b055-2196f175208b {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:41 devstack sudo[102565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-746f0354-1bc6-488a-b055-2196f175208b
Nov 19 13:18:41 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:41 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:41 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8bfccc9f-34f6-4a5b-a161-63af77e40cc7 tempest-CinderUnicodeTest-2009313857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3/volume-746f0354-1bc6-488a-b055-2196f175208b" returned: 0 in 0.465s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:41 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8bfccc9f-34f6-4a5b-a161-63af77e40cc7 tempest-CinderUnicodeTest-2009313857 None] Lock "cinder-quobyte-746f0354-1bc6-488a-b055-2196f175208b" released by "delete_volume" :: held 1.015s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:41 devstack cinder-volume[80839]: DEBUG cinder.quota [None req-8bfccc9f-34f6-4a5b-a161-63af77e40cc7 tempest-CinderUnicodeTest-2009313857 None] Created reservations ['d997fb15-26ce-4416-81ca-1653c39f4041', '0eed518f-2620-43d6-b3fc-a24e588aaa2c', '5a571195-1ae0-40b6-a081-cc04786e7b45', '2b407311-684a-4ff5-a66c-aaa0da964cd6'] {{(pid=80839) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 19 13:18:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8bfccc9f-34f6-4a5b-a161-63af77e40cc7 tempest-CinderUnicodeTest-2009313857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Nov 19 13:18:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8bfccc9f-34f6-4a5b-a161-63af77e40cc7 tempest-CinderUnicodeTest-2009313857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Nov 19 13:18:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8bfccc9f-34f6-4a5b-a161-63af77e40cc7 tempest-CinderUnicodeTest-2009313857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0': None} {{(pid=80839) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:601}}
Nov 19 13:18:42 devstack cinder-volume[80839]: DEBUG cinder.volume.drivers.quobyte [None req-8bfccc9f-34f6-4a5b-a161-63af77e40cc7 tempest-CinderUnicodeTest-2009313857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87260f92-3551-4182-b0ca-2a6c984928f0'] {{(pid=80839) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:631}}
Nov 19 13:18:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.lockutils [None req-8bfccc9f-34f6-4a5b-a161-63af77e40cc7 tempest-CinderUnicodeTest-2009313857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Nov 19 13:18:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8bfccc9f-34f6-4a5b-a161-63af77e40cc7 tempest-CinderUnicodeTest-2009313857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3 {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Nov 19 13:18:42 devstack sudo[102569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3
Nov 19 13:18:42 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 19 13:18:42 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root
Nov 19 13:18:42 devstack cinder-volume[80839]: DEBUG oslo_concurrency.processutils [None req-8bfccc9f-34f6-4a5b-a161-63af77e40cc7 tempest-CinderUnicodeTest-2009313857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3d4e93f41e61708b5064d945bd0d95b3" returned: 0 in 0.431s {{(pid=80839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Nov 19 13:18:42 devstack cinder-volume[80839]: DEBUG cinder.manager [None req-8bfccc9f-34f6-4a5b-a161-63af77e40cc7 tempest-CinderUnicodeTest-2009313857 None] Notifying Schedulers of capabilities ... {{(pid=80839) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Nov 19 13:18:42 devstack cinder-volume[80839]: INFO cinder.volume.manager [None req-8bfccc9f-34f6-4a5b-a161-63af77e40cc7 tempest-CinderUnicodeTest-2009313857 None] Deleted volume successfully.
Nov 19 13:18:42 devstack cinder-volume[80839]: DEBUG cinder.coordination [None req-8bfccc9f-34f6-4a5b-a161-63af77e40cc7 tempest-CinderUnicodeTest-2009313857 None] Lock "cinder-746f0354-1bc6-488a-b055-2196f175208b-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=80839) __release /opt/stack/cinder/cinder/coordination.py:157}}
Nov 19 13:18:52 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=99,cinder:INSERT=33,cinder:UPDATE=156,cinder:DELETE=11 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Nov 19 13:18:52 devstack cinder-volume[80839]: DEBUG dbcounter [-] [80839] Writing DB stats cinder:SELECT=87,cinder:UPDATE=146,cinder:DELETE=14,cinder:INSERT=39 {{(pid=80839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}